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SIGNIFICANCE  OF  ORGANIZATIONAL  EMBLEM 

The  emblem  is  symbolic  of  the  Laboratory,  and  the  Air  Force  colors,  ultramarine 
blue  and  golden  yellow,  are  used  in  the  design.  The  color  blue  alludes  to  the 
sky,  the  primary  theater  of  Air  Force  operations  and  yellow  to  the  sun  and 
excellence  of  personnel  in  assigned  duties.  The  silhouette  of  man  represents 
Human  Resources  generally,  and  the  progress  line  is  symbolic  of  Improvement  of 
man  through  research  and  application  of  that  research.  The  stars  are  repre¬ 
sentative  of  the  goals  of  human  research,  tfiich  are  unlimited. 


AFHRL  MISSION 


)/ 

The  Air  Force  Human  Resources  Labora¬ 
tory  (AFHRL)  is  the  principal  AFSC 
organization  charged  with  planning  and 
executing  the  USAF  exploratory  and  ad¬ 
vanced  developaent  programs  in  manpower 
and  personnel,  education  and  training, 
simulation  and  training  devices,  and 
logistics  and  group  aspects  of  human 
factors,  for  research  and  development 
(R&D)'-  related  to  personnel,  flight 
training,  simulation,  logistics,  and 
technical  training. 


ORIGIN 

In  the  late  1960’s,  the  Secretary  of  the  Air  Force  and  the  Air  Force  Chief  of 
Staff  decided  to  redefine  the  Air  Force's  R&D  efforts  in  the  related  areas  of 
personnel  and  training.  In  August  1967,  the  augmented  Psychology  and  Social 
Sciences  Panel  of  the  USAF  Scientific  Advisory  Board  conducted  a  study  concern¬ 
ing  such  R&D  work.  In  its  report,  the  board  developed  certain  standards  needed 
for  a  successful  program:  (a)  the  requirement  for  managers  of  these  R&D 
efforts  ‘to  possess  and  display  a  keen  interest  in  the  entire  program,  (b)  the 
proper  allocation  of  sufficient  funding  commensurate  to  the  work  being  accom¬ 
plished,  (c)  the  acquisition  and  retention  of  well -trained  and  highly  qualified 
people,  (d)  the  recognition  that  the  "human  factor"  involved  in  personnel  and 
training  R&D  makes  it  a  unique  entity  that  cannot  be  compared  to  the  hardware 
R&D  in  the  Air  Force's  respective  physical  science  laboratories,  (e)  the  need 
for  R&D  functions  to  be  geographically  close  to  the  organizations  that  most 
effectively  applied  the  results  of  that  work,  and  (f)  the  need  for  a  proper 
balance  between  finding  solutions  to  current  problems  and  the  achievement  of 
long-range  R&D  go?ls.  On  July  1,  1968,  AFHRL  was  established  with  an  organiza¬ 
tional-  structure ‘that  has  allowed  it  to  effectively  carry  out  its  mission  over 
the  last  18.  years; 
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MESSAGE  FROM  THE  COMMANDER 


As  Commander  of  Che  Air  Force  Human 
Resources  Laboratory,  I  take  great 
pride  in  reviewing  our  accomplishments 
over  the  past  year.  1986  has  been  a 
banner  year.  We've  transitioned  sev¬ 
eral  products  to  the  Air  Force.  This 
book  is  designed  to  describe  them. 

AFHRL  is  the  Air  Force's  Manpower,  Per¬ 
sonnel,  Training,  and  Logistics  Labor¬ 
atory.  Its  aim  is  to  improve  the  com¬ 
bat  readiness  of  our  forces. 

The  Manpower  and  Personnel  Division 
conducts  R&D  in  personnel  selection, 
classification,  assignment,  evaluation, 
and  retention.  This  R&D  improves  the 
quality  of  the  work  force. 

The  Training  Systems  Division  conducts 
R&D  that  improves  management  and  train¬ 
ing  delivery  in  on-the-job,  computer- 
based,  and  classroom  training;  inte¬ 
grates  training  with  manpower  and  per¬ 
sonnel  factors  for  improved  job  per¬ 
formance;  and  helps  to  ensure  a  highly 
skilled  work  force. 

The  Logistics  and  Human  Factors  Divi¬ 
sion  conducts  R&D  in  aircraft  mainte¬ 
nance  in  combat  environments,  in  logis¬ 
tics,  and  in  team  training  for  command 
and  control.  This  Division  also  is 
investigating  the  management  science 
and  human  factors  aspects  of  weapon 
system  technologies  for  consideration 
of  logistics  factors  in  each  step  of 
the  development  and  acquisition  pro¬ 
cess  . 

The  Operations  Training  Division  is 
responsible  for  R&D  in  pilot  training 
and  combat  mission  training,  and  the 
application  of  technology  to  develop 
training  simulators.  Their  R&D  efforts 
serve  to  ensure  operational  effective¬ 
ness  through  a  combat-ready,  quality 
force . 

Along  with  the  Technical  Services  Divi¬ 
sion,  which  manages  databases  and  de¬ 
velops  software  in  support  of  the  R&D, 


Dr.  Earl  A.  Alluisi,  Dennis  W.  Jarvi 

Chief  scientist  Colonel,  USAF 

Commander 


these  divisions  work  together  to  build 
a  stronger  and  more  effective  Air 
Force. 

AFHRL's  developments  cover  a  wide 
spectrum,  from  new  personnel  and  test¬ 
ing  techniques  to  innovations  in  elec¬ 
tronic  combat  training.  AFHRL  has 
developed  its  enlisted  and  officer  se¬ 
lection  and  classif ication  tests.  Pi¬ 
lot  and  navigator  selection  programs 
have  also  been  implemented. 

The  future  looks  bright  and  challenging 
for  AFHRL  as  we  aspire  to  broaden  our 
scope  in  the  areas  of  space  explora¬ 
tion,  improved  R&D  for  the  Air  Force 
Reserve  and  Air  National  Guard,  train¬ 
ing  effectiveness,  and  artificial  in¬ 
telligence.  AFHRL  will  play  a  crucial 
role  in  Space  Command's  upcoming  selec¬ 
tion  and  training  of  system  operators, 
maintainers,  pilots,  and  astronauts. 
Artificial  intelligence  R&D  will  be 
applied  to  complex  weapon  system  sup¬ 
port  and  training. 


DENNIS  W.  JARVI,  Colonel,  USAF 
Commander 


PLANS  AND  OPERATIONS  OFFICE 


The  Plans  and  Operations  Office  plans, 
implements,  and  monitors  the  execution 
of  the  AFHRL  R&D  program.  The  Office 
performs  long-range  planning,  including 
front-end  analyses,  that  combines 
higher  headquarters  guidance,  Air  Force 
user  requirements,  and  technological 
opportunities.  The  Office  Staff  eval¬ 
uates  Independent  Research  and  Develop¬ 
ment  projects  of  industry,  tracks  Lab¬ 
oratory  accomplishments,  and  prepares 
technology  transition  plans.  Office 
personnel  publish  all  planning  docu¬ 
ments  and  prepare  all  budget  submis¬ 
sions  to  higher  headquarters.  The 
Office  effects  program  implementation 
by  processing  all  financial  and  budget¬ 
ary  documents.  It  monitors  progress 
of  all  support,  contractual,  and  in- 
house  efforts,  and  provides  the  re¬ 
source  management  required  to  execute 
an  effective  R&D  program. 

EXECUTIVE  SUPPORT  OFFICE 

The  Executive  Support  Office  develops 
and  implements  policies,  procedures, 
and  standards  relating  to  administra¬ 
tion  management  and  practices,  military 
and  civilian  personnel  and  manpower 
actions,  and  materiel  actions.  The 
Office  provides  staff  guidance,  assist¬ 
ance,  and  surveillance  over  other  ech¬ 
elons  in  areas  of  functional  responsi¬ 
bility  for  the  Laboratory  Commander. 

The  Office  Staff  operates  the  following 
programs:  manpower  and  organization, 
reports  management,  document  security, 
military  and  civilian  personnel  admin¬ 
istration,  including  training  programs, 
and  organizational  supply.  Further,  the 
Executive  Support  Office  is  the  princi¬ 
pal  focal  point  for  host-tenant  support 
agreements  for  the  Laboratory  and  rep¬ 
resents  the  Laboratory  in  dealings  with 
other  agencies  and  higher  headquarters 
in  all  areas  of  functional  responsibil¬ 
ities,  and  serves  as  focal  point  for 
Inspector  General  visits  and  reports. 


Dr.  Herbert  J.  Clark 
Director,  Plans  and  Operations  Office 


Captain  James  E.  Watson 
Director,  Executive  Support  Office 
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OPERATIONS  TRAINING  DIVISION 


The  Operations  Training  Division 
AFHRL  has  a  unique  role  as  the  only 
Force  agency  devoted  to  the  explo 
tion  oi  science  and  technology 
improve  aircrew  training.  The  D 
sion's  R&D  programs  dynamically 
tribute  to  the  effectiveness 
efficiency  of  flying  training  thro 
out  the  Air  Force.  Formed  in  19b 
that  integral  part  of  the  AFHRL  res 
sible  for  flying  training,  the  Op 
tions  Training  Division  performs 
mission  through  two  primary  functi 
(a)  behavioral  R&D  to  solve  fl 
training  problems  through  impr 


Operational  Unit  Training  Branch 

The  Operational  Unit  Training  Branch 
(OTU)  is  responsible  for  exploratory 
development  R&D  programs  directed  to¬ 
ward  solving  operational  problems  in 
Air  Force  aircrew  training  at  the  in¬ 
dividual,  crew,  and  team  levels. 
Branch  projects  address  all  facets  of 
aircrew  training  which  concern  acquisi¬ 
tion,  maintenance,  and  reacquisition 
of  flying  knowledge  and  skills  for  such 
units.  This  Branch's  primary  objec¬ 
tives  are  to  increase  force  effective¬ 
ness  and  survivability  through  enhanced 
combat  readiness  and  flying  safety. 
These  goals  are  accomplished  through 
R&D  focused  upon  electronic  combat 
training  systems,  development  and  im¬ 
plementation  of  aircrew  performance 
measurement,  simulator  instructional 
strategies  and  technologies,  total 
training  system  design,  training 
system/device  evaluations,  and  the 
development  of  part-task  trainers  cap¬ 
able  of  supporting  unit  training  needs. 
OTU 1  s  products  are  databases,  proce¬ 
dures,  and  training  devices  validated 
through  experimentation,  field  studies, 
and  demonstrations.  This  Branch's  ac¬ 
tivities  promote  the  use  of  new  train¬ 
ing  methods  and  efficient  simulation 
utilization. 

The  major  efforts  of  the  Branch  are 
documented  in  the  descriptions  of  on¬ 
going  work  in  performance  measurement, 
training  system  design,  electronic  com¬ 
bat,  and  part-task  trainer  R&D.  There 
are,  however,  several  other  noteworthy 
Branch  activities. 

Current  trends  within  the  USAF  point 
toward:  (a)  developing  and  implement¬ 
ing  integrated  weapon  training  systems; 
and  (b)  contracted-out  training.  To 
date,  such  an  approach  has  not  been  im¬ 
plemented  or  evaluated  for  fighter/ 
attack-type  weapon  systems.  One  indus¬ 
trial  firm  has  responded  to  this  oppor¬ 
tunity  by  establishing  a  center  for 
advanced  airmanship  that  combines  aca¬ 
demic  and  simulator  training  for  the 


F-5  aircraft.  In  support  of  the  Tacti¬ 
cal  Air  Command  (TAC),  AFHRL  has  de¬ 
signed,  and  is  actively  supporting,  an 
evaluation  of  this  training  concept 
(i.e.,  combined  academics  and  simula¬ 
tion  training)  as  it  applies  to  the 
fighter  training  community.  A  two-part 
evaluation  is  underway.  Part  I  is 
focusing  on  the  evaluation  of  training 
hardware  and  courseware  from  the  per¬ 
spectives  of  technical  accuracy  of 
training  materials,  completeness  of 
training  materials,  and  related  human 
factors  concerns.  Part  II  is  focusing 
on  training  transfer  and  effectiveness 
issues.  Results  of  the  evaluation  will 
be  available  in  April  1987.  In  a  re¬ 
lated  effort,  a  program  has  been  initi¬ 
ated  that  will  examine  the  feasibility, 
potential  payoffs,  and  implementation 
requirements  for  applying  similar 
ground-based  training  concepts  to  TAC's 
fighter  lead-in  training  program. 

At  the  Division's  Tucson  operating  lo¬ 
cation,  our  Tactical  Training  Evalua¬ 
tion  Center  (TTEC),  established  in 
1985,  is  collocated  with  the  162d  Tac¬ 
tical  Fighter  Group  of  the  Arizona  Air 
National  Guard.  This  working  relation¬ 
ship  has  provided  the  Operations  Train¬ 
ing  Division  with  the  opportunity  to 
participate  first-hand  in  Low-Altitude 
Training  (LAT)  R&D.  This  is  the  only 
LAT  program  currently  authorized  for 
the  Tactical  Air  Forces,  and  it  has 
already  resulted  in  the  development  of 
a  unique  LAT  flight  course  and  training 
manuals.  Development  of  a  part-task 
trainer  for  visual  cues  is  underway  and 
will  be  used  to  enhance  training  on 
low-altitude  flight.  In  the  near  fu¬ 
ture  the  TTEC  will  serve  as  an  opera¬ 
tional  training  research  laboratory  for 
a  number  of  projects,  such  as  an  in- 
house  effort  on  visual  cueing,  evalua¬ 
tion  of  an  in-flight  data-recording 
capability,  and  transfer-of-training 
studies  on  air-to-air  radar  intercept 
tasks.  Long-range  plans  include  in- 
depth  analysis  of  aircrew  performance, 
combat  readiness,  and  workload. 


In  support  of  aircrew  selection  and  Contact:  Dr.  Thomas  H.  Gray 

classification  R&D  being  conducted  by  AFHRL/OTG 

the  Manpower  and  Personnel  Division,  Williams  AFB,  AZ  85240-6547 

OTU  is  involved  in  a  validation  effort  Commercial  (602)  988-6561 

for  the  Basic  Attributes  Test  (BAT).  AUTOVON  474-6561 

Data  have  been  collected  on  30  F-15 
student  pilots  out  of  the  total  of  75 
required  subjects.  When  data  collec¬ 
tion  is  completed,  these  data  will  al¬ 
low  the  correlation  of  performance  on  '•f'xgp 
each  BAT  predictor  with  actual  flight 
performance  and  instructor  pilots1  sub¬ 
jective  evaluations.  These  data  will 
then  be  used  to  further  refine  the  BAT 
for  screening  before  undergraduate 
pilot  training,  and  to  help  identify 
potential  students  for  Fighter-Attack- 
Reconnaissance  (FAR)  aircrew  training 
when  the  dual-track  program  is  imple¬ 
mented. 

The  Instructor/Operator  Station  (IOS), 
including  instructional  support  fea¬ 
tures,  is  a  critical  component  in  pro¬ 
viding  aircrews  with  training  not 
available  in  the  aircraft.  OTU  is  re¬ 
sponsible  for  RAD  in  Air  Force  use  of, 
and  production  of  guidelines  for,  opti-  Computer  Generated  Image,  C-130 

mal  instructional  support  features  and 

development  of  human  factors  databases  Training  System  Design 

for  IOS  design,  and  is  working  on  a 

generic  IOS  design  guide.  The  primary  The  Military  Airlift  Command  (MAC)  mis¬ 
users  for  these  products  are  the  Aero-  sion  is  quite  broad,  and  the  system 

nautical  Systems  Division  and  the  Major  supporting  the  training  required  for 

Commands.  However,  DOD  contractors  and  this  mission  involves  such  diverse 

foreign  governments  are  also  using  functions  as  training  development,  de- 

these  guidelines  in  the  development  and  livery,  management,  analysis  and  evalu- 

acquisition  of  simulator  IOSs  and  in-  ation,  and  support.  Specifically,  as 

structional  support  capabilities.  related  to  the  C-130  weapon  system,  the 

problem  facing  MAC  is  that  exercises 
Another  important  role  played  by  many  and  operational  readiness  inspections 

of  the  people  on  the  OTU  staff  is  that  have  revealed  the  need  for  more  exten- 

of  consultant,  or  subject-matter  ex-  sive  aircrew  combat  tactics  training, 

pert.  Serving  in  this  capacity,  OTU  However,  flight  hours  for  practicing 

personnel  have  given  Air  Force  agencies  combat  tactics  are  not  available,  due 

valuable  assistance  concerning  elec-  in  part  to  the  demands  of  initial  and 

tronic  combat  training,  aircrew  train-  upgrade  training,  as  well  as  the  profi- 

ing  device  evaluation,  computer-based  ciency  requirements  of  continuation 

instruction  and  management,  and  use  of  training.  Thus,  C-130  aircrew  training 

training  resources.  Although  these  in-  must  be  made  more  efficient  to  free 

teractions  account  for  only  a  small  mission-critical  resources  so  they  can 

portion  of  total  duty  time,  they  have  be  devoted  to  raising  combat  skill  lev- 

significant  impacts  that  directly  re-  els.  The  Air  Force  Scientific  Advisory 

suit  in  changing  the  way  the  Air  Force  Board  has  recommended  increased  use  of 

conducts  its  aircrew  training.  simulators  and  part-task  trainers  to 


add  Co  Che  safeCy  and  proficiency  of 
noncombac  Craining,  so  as  Co  allow  for 
reallocacion  of  flighc  hours  Co  realis- 
Cic  combat  Craining. 

In  response  Co  Chis  challenging  train¬ 
ing  problem,  the  Operacions  Training 
Division  initiated  an  R&D  program  Co 
develop  a  total  aircrew  Craining  pro¬ 
gram  for  the  C-130  weapon  system  that 
will  encompass  the  full  scope  of  train¬ 
ing  experiences  extending  from  initial 
entry  through  continuation  training. 
The  system  will  make  effective  use  of 
advanced  training  concepts,  techniques, 
and  state-of-the-art  hardware.  The 
prototype  system  will  be  developed  for 
implementation  at  Little  Rock  AFB, 
where  all  training  phases  are  collo¬ 
cated  and  ground  training  devices  in¬ 
clude  the  Weapon  System  Trainer,  which 
has  a  full-mission  visual  simulation 
capability.  The  total  program,  known 
as  the  Model  Aircrew  Training  System 
(MATS)  will  be  comprised  of:  (a)  a 
training  system  that  includes  all  syl¬ 
labi,  learning  objectives,  performance 
standards,  evaluation  procedures,  se¬ 
lection  of  training  media,  and  quality 
control  techniques  and  (b)  a  computer- 
based  support  system  to  provide  for 
training  program  development,  instruc¬ 
tional  delivery,  evaluation  of  crew 
performance,  and  total  system  manage¬ 
ment.  The  program  will  serve  as  a 
model  for  application  of  state-of-the- 
art  training  system  development,  man¬ 
agement,  and  delivery  techniques  to  a 
wide  range  of  Air  Force  training  needs. 

The  MATS  R&D  has  been  completed,  and 
final  reports  of  findings  and  recommen¬ 
dations  are  in  press.  These  reports 
contain:  (a)  a  detailed  review  and 
analysis  of  C-130  mission  and  task  re¬ 
quirements;  (b)  a  review  of  state-of- 
the-art  in  training  technology  and  sys¬ 
tem  evaluation  techniques;  (c)  a  review 
of  current  C-130  training  resources  and 
practices;  and  (d)  a  description  of  the 
system  architecture  for  a  mission- 
oriented,  prof iciency-based,  training 
system.  They  provide  specific  recom¬ 
mendations  for  implementation  of  a  new 
integrated  approach  to  training  for  the 


C-130  which  is  individualized  and  self- 
paced  and  utilizes  concepts  from  modern 
learning  theory.  They  also  recommend 
a  computer-based  subsystem  for  the  de¬ 
livery  and  management  of  instruction 
as  well  as  the  allocation  and  schedul¬ 
ing  of  all  training  resources,  includ¬ 
ing  the  aircraft. 

The  MATS  program  developed  a  package 
consisting  of  a  functional  design  spec¬ 
ification,  a  development  and  implemen¬ 
tation  plan  that  provides  guidance  con¬ 
cerning  personnel  requirements,  cost 
and  scheduling  information,  and  a  test 
and  evaluation  plan.  This  test  and 
evaluation  plan  provides  a  detailed 
life-cycle  approach  (a)  to  evaluate  the 
extent  to  which  C-130  aircrews  acquire 
and  maintain  proficiency;  (b)  to  as¬ 
sess  the  development,  implementation, 
and  operation  of  the  C-130  MATS  itself; 
and  (c)  to  evaluate  the  value  of  MATS 
as  a  general  model  for  application  to 
other  systems.  This  plan  also  includes 
recommendations  for  an  ongoing  R&D  pro¬ 
gram  to  provide  a  basis  for  the  design 
and/or  evaluation  of  new  concepts  in 
aircrew  training  and  to  upgrade  the 
effectiveness/efficiency  of  the  MATS 
itself. 

The  findings  and  recommendations  from 
the  MATS  effort  have  been  utilized  by 
Simulator  Special  Project  Office  of  the 
Aeronautical  Systems  Division  in  the 
development  of  the  Request  For  Proposal 
(RFP)  for  the  C-130  Aircrew  Training 
System  (ATS).  They  have  also  been  used 
by  MAC  Headquarters  as  a  basis  for 
planning  for  the  implementation,  test, 
and  evaluation  of  the  new  C-130  ATS 
and  have  been  provided  to  all  bidders 
on  the  C-130  ATS  RFP  for  guidance.  In 
addition,  the  findings  and  lessons  from 
this  effort  have  been  applied  to  a  num¬ 
ber  of  other  programs  including  the  C-5 
and  C-17. 


Contact:  Dr.  Robert  T.  Nullmeyer 
AFHRL/OTU 

Williams  AFB,  AZ  85240-6547 
Commercial  (602)  988-6561 
AUTOVON  474-6561 
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Aircrew  Performance  Measurement 

The  Operations  Training  Division  has 
developed  an  Air  Combat  Maneuvering 
Performance  Measurement  System  (ACM 
PMS)  that  will  be  used  to  conduct  R&D 
aimed  at  providing  TAC  with  valid  meas¬ 
ures  of  aircrew  performance  necessary 
for  evaluating  the  effectiveness  of 
present  and  future  air-to-air  combat 
training  devices.  This  project  is  in 
part  a  response  to  the  Defense  Science 
Board  1982  Summer  Study  that  called  for 
greater  R&D  emphasis  on  performance 
measurement.  The  ACM  PMS  is  a  perform¬ 
ance  data  collection  and  analysis  sys¬ 
tem  that  will  be  implemented  on  the 
Simulator  for  Air-to-Air  Combat  (SAAC) 
and  the  Air  Combat  Maneuvering  Instru¬ 
mentation  (ACM1)  range  at  Luke  AFB. 
The  ACM  PMS  will  support  R&D  on:  (a) 
measurement  development,  validation, 
and  refinement;  (b)  the  use  of  computer 
graphics  for  real-time  information  dis¬ 
play;  (c)  the  use  of  computer  graphics 
to  support  post-mission  debriefing; 
(d)  training  effectiveness  of  the  SAAC 
and  the  ACM1;  (e)  simulator  visual  re¬ 
quirements;  and  (f)  providing  selec¬ 
tion  criteria  for  the  FAR  pilots  in 
dual-track  training  programs. 
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R&D  plans  have  been  developed  for  ap¬ 
plying  expert  systems  technology  to  the 
areas  of  real-time  performance  monitor¬ 
ing  and  graphic  post-mission  debrief¬ 
ing.  These  efforts  should  significant¬ 
ly  enhance  the  instructor  pilot's  abil¬ 
ity  to  instruct  student  pilots  using 
the  ACM  PMS  in  conjunction  with  the 
SAAC  or  ACMI. 

An  Air-to-Sur face  Performance  Measure¬ 
ment  System  (AS  PMS)  is  currently  being 
developed  in  parallel  with  the  ACM  PMS. 

The  AS  PMS  will  take  advantage  of  ex¬ 
isting  ACM  PMS  hardware  and  software,  ; 

and  be  implemented  at  Williams  AFB  to 
improve  the  Laboratory's  ability  to 
conduct  training  effectiveness  R&D. 

Also  part  of  the  performance  measure¬ 
ment  program  is  the  Airborne  Measure¬ 
ment  Concepts  (AMC)  effort  for  advanced 
tactical  aircraft.  This  effort  will 
define  the  airborne  performance  meas¬ 
urement  requirements  necessary  to  sup¬ 
port  tactical  training  in  the  1990s. 

Areas  to  be  addressed  will  include 
embedded  electronic  countermeasures 
training,  real-time  kill  assessment  and 
removal,  and  data  linking  of  multiple 
aircraft.  R&D  on  the  Air  Combat  Maneu¬ 
vering  Performance  Measurement  System 
should  provide  the  AMC  effort  with  pro¬ 
cedures  for  conducting  computer-assist¬ 
ed  mission  debriefing.  j 

The  Division's  R&D  in  performance  meas-  , 

urement  is  being  conducted  with  ASD  in  j 

support  of  the  Training  Effectiveness  < 

Plan  (TEP),  and  will  provide  perform¬ 
ance  metrics  for  other  TEP  programs, 
such  as  those  addressing  the  visual  and 
sensor  requirements  necessary  for  sup¬ 
porting  future  tactical  aircrew  train¬ 
ing. 


Contact:  Dr.  Gary  S.  Thomas 
AFHRL/OTA 

Williams  AFB,  AZ  85240-6547 
Commercial  (602)  988-6561 
AUTOVON  474-6561 


Air  Performance  Measurement  Graphics 


Air-to-Air  Intercept  Trainer 


Part-Task  Training  R&D 

The  Air  Force  has  an  urgent  need  for 
effective  yet  low-cost  training  devices 
and  methods.  Major  Commands  (MAJCOMs) 
continually  seek  training  technologies 
that  can  improve  the  proficiency  and 
readiness  of  their  combat  aircrews. 
One  goal,  implicit  in  the  search  for 
effective,  least-cost  training  solu¬ 
tions,  is  the  capability  to  offload 
expensive  training  devices  such  as 
Full-Mission  Simulators  (FMSs)  and  air¬ 
craft  by  using  part-task  training 
,  devices  of  advanced  design  with  which 

1  aircrews  can  acquire  needed  basic  cog- 

[  nitive  and  procedural  skill  components, 

i  Low-cost  computer  technologies  now 

\  offer  the  potential  to  satisfy  many 

training  requirements,  providing  that 
i  effective  part-task  approaches  and 

|  methodologies  can  be  identified  or 

i  developed. 

! 


Part-task  training  R&D  began  with  the 
assessment  of  technology  applications 
as  a  means  of  improving  combat  aircrew 
training  effectiveness.  Surveys  of  the 
Strategic  Air  Command  (SAC),  the  Mili¬ 
tary  Airlift  Command  (MAC),  and  the 
Tactical  Air  Command  (TAC)  showed  that 
a  wide  variety  of  training  requirements 
could  be  supported  using  low-cost, 
part-task  trainers.  Three  experimental 
investigations  were  conducted  to  deter¬ 
mine  the  potential  of  microcomputer- 
based  part-task  devices  for  training 
procedural  tasks.  The  findings  showed 
that  part-task  trainers  (a)  effectively 
train  procedural  and  cognitive  tasks 
without  the  need  for  costly  cockpit 
repeater  instruments  and  controls,  (b) 
can  be  used  to  offload  FMSs  for  basic 
skills  training,  and  (c)  represent 
large  cost-avoidance  potential  as  ap¬ 
plied  to  operational  unit  training  pro¬ 
grams  . 


The  Operations  Training  Division's  R&D 
is  focused  toward  developing  a  sound 
scientific  foundation  upon  which  to 
determine  part-task  training  strategy. 
Specifically,  the  intent  is  to  generate 
a  database  sufficient  to  support  the 
identification  and  selection  of  train¬ 
ing  strategies  and  the  design  of  de¬ 
vices  for  specific  types  of  training 
tasks.  Database  development  includes 
both  theoretical  and  empirical  re¬ 
search.  A  comprehensive  review  of  the 
existing  psychological  literature 
related  to  part-task  learning  was 
recently  completed,  and  several  method¬ 
ology  experiments  have  been  conducted. 
The  database,  when  completed,  will  be 
accessible  via  an  automated  Decision 
Support  System  (DSS).  The  DSS  will 
facilitate  the  analysis  of  specific 
training  tasks  in  order  to  determine 
optimal  sequencing  of  task  sub-parts 
and  to  identify  other  relevant  training 
methods.  At  present,  a  preliminary  DSS 
has  been  developed  for  demonstration 
purposes.  As  theoretical  and  empirical 
data  accrue  from  R&D,  they  will  be  used 
to  augment  the  database. 

Another  promising  avenue  of  R&D  in 
part-task  training  is  the  use  of  com¬ 
puter-based  analytical  models.  These 
models  replicate  the  decision-making 
behaviors  of  a  pilot  performing  the 
task  in  the  real  world.  The  knowledge 
or  rule  base  contained  in  the  models 
can  be  varied  to  represent  different 
levels  of  performance  proficiency.  By 
manipulating  the  computer  model,  scien¬ 
tists  can  determine  the  cause-effect 
relationships  that  influence  skill 
development.  The  modeling  process  can 
then  be  used  to  predict  learner  behav¬ 
ior  on  the  task  and  to  determine  appro¬ 
priate  training  methods.  Thus  far, 
analytical  models  have  been  developed 
for  an  air-to-air  radar  intercept  task 
and  a  30-degree  dive  bombing  task. 

To  give  substance  to  this  program,  ex¬ 
perimental  trainers  are  being  developed 
for  each  of  the  MAJCOMs.  The  purpose 
is  twofold.  The  trainers  are  to  serve 
as  state-of-the-art  part-task  training 


demonstrations.  Each  trainer  is  fo¬ 
cused  upon  a  single  part-task  training 
problem  in  which  new  design  concepts 
and  training  methods  are  developed  and 
evaluated  in  close  concert  with  the 
user  command.  Design  concepts  include 
high-fidelity  simulation  of  relevant 
task  portions,  performance  measurement 
embedded  within  software,  and  automated 
on-task  guidance  and  feedback  to  the 
learner.  The  second  purpose  of  this 
program  will  be  realized  as  device  de¬ 
signs  mature  and  are  validated  and 
part-task  trainers  are  transferred  to 
the  user  commands.  Three  such  trainers 
are  under  development:  a  low-altitude 
awareness  trainer  for  the  Air  National 
Guard;  an  air-to-air  radar  intercept 
trainer  for  F-16  pilot  training  for  the 
Tactical  Air  Command;  and  a  threat 
avoidance  and  tactics  trainer  for  the 
Strategic  Air  Command. 

Contact:  Dr.  Bernell  J.  Edwards 

AFHRL/OTA 

Williams  AFB,  AZ  85240-6457 

Commercial  (602)  988-6561 
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Electronic  Combat  Training  Effective¬ 
ness 

The  modern  battlefield  is  populated  by 
ever-increasing  numbers  of  sophisti¬ 
cated  air-to-air  and  surface-to-air 
threat  systems.  To  survive  in  this 
environment,  the  aircrew  must  be  able 
to  recognize  critical  cues  and  make 
quick  decisions  concerning  the  appro¬ 
priate  tactics  to  employ.  Electronic 
Combat  (EC)  training  is  intended  to 
prepare  the  aircrew  to  take  advantage 
of  threat  system  vulnerabilities  and 
their  own  weapon  system  capabilities 
to  avoid,  defeat,  or  destroy  the 
threat.  The  problem  of  providing  real¬ 
istic  EC  training  is  substantial;  how¬ 
ever,  EC-capable  ranges  are  limited  in 
number  due  to  cost  and  airspace  con¬ 
siderations.  Security  and  safety  con¬ 
siderations  place  limits  on  the  prac¬ 
tice  of  realistic  tactics  in-flight. 


Flight  simulators  suffer  from  difficul¬ 
ties  in  maintaining  currency  with  air¬ 
craft  EC  systems,  which  change  ever 
more  rapidly  as  the  capability  of 
reprogramming  increases.  Such  consid¬ 
erations  have  led  the  Tactical  Air 
Command  toward  systems  such  as  the  On- 
Board  Electronic  Warfare  Simulator 
(OBEWS)  for  in-flight  training  and  the 
EC  part-task  trainer  for  ground  train¬ 
ing.  However,  the  effective  use  of 
such  systems  depends  on  understanding 
what  contributions  they  can  make  to 
training  both  individually  and  in  an 
integrated  training  program. 


Electronic  Combat  Environment 


The  Operations  Training  Division  is 
addressing  this  problem  through  an  R&D 
program  aimed  at  the  initiation  and 
evaluation  of  an  integrated  EC  training 
program  for  the  F-16  aircraft.  This 
program  can  then  serve  as  a  model  for 
other  weapon  systems,  and  as  the  basis 
for  examining  the  costs  and  benefits 
of  various  investment  strategies  for 
EC  training  systems.  This  R&D  program 
is  multifaceted  and  involves  such  ef¬ 
forts  as:  (a)  enhancements  to  existing 
threat  modeling  capabilities  in  OT's 
flight  simulators  to  support  the  evalu¬ 
ation  of  realistic  tactics  training 
issues;  (b)  development  of  enhanced 
part-task  training  capabilities,  such 


as  use  of  real-time,  three-dimensional 
representations,  to  evaluate  their  con¬ 
tribution  to  EC  training;  (c)  investi¬ 
gation  of  the  sensitivity  of  tactics 
to  pilot  performance  variations  to 
determine  criteria  for  training;  and 
(d)  development  of  a  methodology  for 
investigating  the  costs  and  benefits 
of  various  EC  training  systems. 

In  the  past  year,  OT  has  assisted  TAC 
in  identifying  the  requirements  for  a 
computer-based  training  system  capable 
of  delivering  the  training  necessary 
to  support  a  variety  of  radar  warning 
receiver  and  electronic  countermeasures 
systems.  The  THREATVAL  effort  has 
identified  a  set  of  high-fidelity 
threat  models  and  associated  visual 
cues  capable  of  providing  real-time 
threat  simulation  on  the  OT  flight 
simulators.  These  models  will  be  im¬ 
plemented  during  FY87.  The  TACTRAIN 
effort  has  investigated  the  sensitivity 
of  tactics  to  performance  variations, 
and  a  final  report  is  in  preparation. 
The  development  of  a  cost/benefit  meth¬ 
odology  for  EC  training  systems  has 
been  initiated.  In  addition,  a  report 
concerning  the  results  of  R&D  address¬ 
ing  feedback  requirements  for  EC  range 
training  systems,  skill  retention,  and 
transfer  of  training  from  the  flight 
simulator  to  the  aircraft  has  been  pub¬ 
lished. 

The  overall  goal  of  these  efforts  is 
to  develop  a  technical  database  on  EC 
training  systems  which  can  support  a 
cost/benefit  model  for  training  and 
provide  an  objective  basis  for  investi¬ 
gation  of  alternative  investment  strat¬ 
egies  for  such  systems.  Initial  re¬ 
sults  suggest  that  this  is  a  productive 
approach,  but  will  require  a  coordi¬ 
nated  effort  from  a  number  of  different 
vantage  points. 


Contact:  Dr.  Thomas  H.  Killion 
AFHRL/OTU 

Williams  AFB,  AZ  85240-6457 
Commercial  (602)  988-6561 
AUTOVON  474-6561 


Technology  Developaent  Branch 

Current  Tactical  Air  Force  simulator 
training  la  typically  Halted  to  proce¬ 
dures  and  eaergency  tasks  due  to  the 
lack  of  adjunct  full -fie Id -of -view, 
hlgh-perforaance  visual  systems.  Con- 
bat  skills  for  the  aost  part  cannot  be 
trained  on  these  "blind "  devices. 


The  Technology  Developaent  Branch  (OTE) 
Is  working  to  solve  two  probleas  pre¬ 
venting  deployment  of  high-quality  vi¬ 
sual  systems  for  use  on  fighter  air¬ 
craft  alaulatora  within  the  Tactical 
Air  Forces  (TAF).  The  first  problem 
Is  that  technology  has  not  yet  been  de¬ 
veloped  that  can  provide  a  full-fleld- 
of-view,  hlgh-resolutlon  visual  syatea 
which  can  support  air-to-air  coabat 
training.  The  visual  system  aust  also 
provide  enough  scene  content  to  support 
high-speed,  low-altitude  air-to-ground 
weapons  delivery  training.  The  second 
problea  is  to  ensure  that  the  cost  of 
such  devices  Is  low  enough  to  be  af¬ 
fordable  to  the  TAF  for  use  on  their 
fighter  Weapon  Systems  Trainers  (full 
mission  simulators). 


F-16  Done  Slaulator 
Visual 


The  visual  system  technology  problem 
Is  in  fact  a  two-part  problea,  as  the 
visual  systea  consists  of  two  sub-sys- 
teas:  the  Imagery  source  and  the  laage 
display.  The  Imagery  is  provided  by  a 
very  coaplez  and  costly  device  called 
a  Computer  Image  Generator  (CIG).  The 
aost  challenging  mission  for  the  CIG 
Is,  by  far,  air-to-ground  weapons  de¬ 
livery.  This  mission  calls  for  very 
detailed  scene  content  to  be  presented 
at  very  high  speeds  over  large  areas 
of  terrain.  When  this  problea  was 
first  studied  In  the  late  70s,  It  was 
soon  realized  that  the  information 
bandwidth  for  this  mission  was  well  be¬ 
yond  the  capability  of  computer  laage 
generators  of  that  era.  OTE  conducted 
an  industry-wide  competition  to  develop 
a  computer  laage  generator  to  meet  TAC 
needs.  The  resulting  laage  generator, 
called  the  Advanced  Visual  Technology 
Systea  (AVTS)  was  delivered  by  the  con¬ 
tractor  to  AFHRL  in  September  of  1984. 
It  has  been  tested  and  evaluated  and 
found  to  meet  all  specifications.  It 
can  produce  out-the-window  Imagery  to 
support  TAC  air-to-surface  combat  (low- 
level  flight,  dive  bombing,  strafing, 
and  SAM  evasive  maneuvers)  and  air-to- 
air  combat  (1  vs  1,  2  vs  1,  and  2  vs 
2).  This  image  generator  is  now  being 
integrated  into  the  Division's  simu¬ 
lator  R&D  facility.  Work  Is  also 
underway  to  develop  displays  that  can 
present  this  Imagery  to  the  pilot. 
Both  dome  displays  and  helmet-mounted 
displays  are  being  designed,  built,  and 
tested  against  the  TAF  requirements. 


The  other  major  problem  preventing  mass 
deployment  of  full-field-of-view  visual 
systems  throughout  the  TAF  is  the  very 
high  unit  cost  of  such  systems.  The 
Operations  Training  Division  is  making 
a  two-pronged  attack  on  this  problem. 
The  first  is  to  address  the  visual  and 
sensor  fidelity  issue  of  "How  much  is 
enough  for  accomplishing  training  of 
given  combat  tasks?"  Experimental  in¬ 
vestigations  are  proceeding  to  de¬ 
termine  the  minimum  visual  system 


component  requirements  necessary  to 
support  the  Tactical  Combat  Mission. 
One  example  is  an  R&D  effort  to  deter¬ 
mine  the  required  display  image  resolu¬ 
tion  and  brightness  needed  to  train 
air-to-air  combat. 

The  other  major  fidelity  issue  relates 
to  combat  mission  simulation  require¬ 
ments.  To  this  end,  OTE  is  developing 
the  only  Air  Force  two-ship,  F-16  full- 
mission  air-to-ground  weapons  delivery 
simulator.  It  will  also  be  capable  of 
simulating  the  much  easier  air-to-air 
mission.  It  will  be  used  to  determine 
training  requirements  for  TAF  two-ship 
team  training.  This  simulator  will 
also  serve  as  a  prototype  for  two-ship 
training  in  future  Replacement  Training 
Units.  Both  of  these  fidelity-related 
programs  will  define  simulator  require¬ 
ments  such  that  over-designed  and  over¬ 
costed  training  devices  can  be  avoided. 

The  other  cost-driven  effort  is  the  de¬ 
velopment  of  visual  systems  that  offer 
the  potential  of  much  lower  sub-system 
unit  costs  than  current  technology  now 
affords.  For  example  the  Variable-Acu¬ 
ity  Small  Dome  Display  and  the  Fiber- 
Optic  Helmet-Mounted  Display  will  cost 
in  production  less  than  one-tenth  of 
today's  dome  display  technology. 

Another  serious  shortcoming  in  the 
training  of  tactical  combat  pilots  Is 
the  inability  to  Include  a  large  number 
of  skilled  and  unpredictable  players 
in  the  simulation.  This  Branch  is  ad¬ 
dressing  that  problem  by  initiating  a 
program  called  WARNET.  It  is,  in  con¬ 
cept,  a  pilot-centered  large  network 
of  tactical  combat  simulators.  It  is 
in  the  formulative  stage  at  this  time 
and  will  be  the  subject  of  long-range 
planning  and  analysis  over  the  next 
year. 

This  applied  research  work  is  supported 
by  basic  research  work  in  human  visual 
perception  and  cognition.  The  current 
work  is  in  the  areas  of  color  percep¬ 
tion,  visually  induced  motion,  and 
visual  attention.  New  work  will  be 


started  in  retina  form  perception.  The 
ongoing  work  in  color  perception  will 
be  expanded  to  the  study  of  color  con¬ 
stancy  and  contrast.  All  of  these  R&D 
efforts  have  as  a  goal  a  solid  contri¬ 
bution  to  the  scientific  understanding 
of  perceptual  and  learning  phenomena, 
the  knowledge  of  which  will  result  in 
high  payoff  for  the  Division's  long- 
range  R&D  program. 


Contact:  Mr.  Harold  Geltmacher 
AFHRL/OTE 

Williams  AFB,  AZ  85240-6457 
Commercial  (602)  988-6561 
AUT0V0N  474-6561 


Aircrew  Combat  Mission  Enhancement  R&D 


Aircrew  Combat  Mission  Enhancement 

Aircrew  Combat  Mission  Enhancement 
(ACME)  is  a  Project  Forecast  II  tech¬ 
nology  initiative  designed  to  provide 
pilot-centered  combat  training  for  the 
Tactical  Air  Forces.  ACME'S  objectives 
are  to  develop,  integrate,  and  evaluate 
the  technologies  required  to  simulate 
tactical  air  warfare  for  aircrew  train¬ 
ing  and  mission  rehearsal. 

These  objectives  capitalize  on  recent 
simulation  opportunities  resulting  from 
technological  breakthroughs  in  micro- 


computers  and  networking  which  promise 
to  overcome  some  of  the  current  limi¬ 
tations  in  tactical  aircrew  training. 
These  training  limitations  are  the 
result  of  such  factors  as  dwindling 
airspace,  increasingly  complex  and 
"expens ive-to-shoot"  weapon  systems, 
unavailability  of  ranges,  limited 
threat  encounters,  restricted  flight 
profiles,  inability  to  conduct  realis¬ 
tic  force-on-force  training,  and  inade¬ 
quate  tactical  simulation  facilities. 

As  a  Project  Forecast  II  initiative, 
ACME  will  develop  new  simulation  tech¬ 
nologies  for  tactical  aircrew  training. 
These  technology  developments  will  cul¬ 
minate  in  multi-ship,  transportable 
combat  mission  trainers.  This  technol¬ 
ogy  will  be  demonstrated  with  A-10, 
F-15,  and  F-16  combat  mission  trainers. 
In  addition,  provisions  have  been  made 
to  allow  the  Air  Force  Wright  Aeronau¬ 
tical  Laboratories  (AFWAL),  Air  Force 
Human  Resources  Laboratory/Logistics 
and  Human  Factors  Division,  and  Arm¬ 
strong  Aerospace  Medical  Research  Labo¬ 
ratory  to  demonstrate  other  applica¬ 
tions  of  this  technology  for  Command 
and  Control  wargaming  and  crew  station 
design.  Several  of  the  ACME  technolo¬ 
gies  also  have  potential  application 
to  Super  Cockpit. 

To  develop  these  combat  mission  train¬ 
ers,  ACME  will  f ocus  on  combat-essen¬ 
tial  tasks  and  will  rely  on  new  ap¬ 
proaches  to  simulation.  The  specific 
technologies  to  be  developed  within 
ACME  include:  smaller,  lower-cost  com¬ 
puter  image  generators;  improved  dis¬ 
play  systems;  local  and  long  distance 
simulator  networking;  distributed  mi¬ 
croprocessor-based  computational  sys¬ 
tems;  and  improved  database  develop¬ 
ment  techniques.  These  technologies 
will  be  developed  in  cooperation  with 
AFWAL,  Defense  Advanced  Research  Pro¬ 
jects  Agency,  Defense  Mapping  Agency 
Aerospace  Center,  and  Rome  Air  Develop¬ 
ment  Center,  as  well  as  the  Army  and 
Navy. 


during  FY87.  Engineering  development 
of  a  transportable  two-ship  F-16  will 
begin  in  FY88.  Multi-ship  A-10  and 
F-15  development  will  also  begin  in 
FY88  as  part  of  project  WARNET. 

Contact:  Dr.  Herbert  H.  Bell 
AFHRL/OTE 

Williams  AFB,  AZ  85240-6457 
Commercial  (602)  988-6561 
AUTOVON  474-6561 


F-16  Dome  Simulator 


Visual  Systems  Technology 

There  are  two  functional  issues  of  con¬ 
cern  in  the  area  of  simulator  visual 
systems  technology.  First,  current 
technology  will  not  support  the  broad 
spectrum  of  Air  Force  flight  simulation 
training  requirements.  Although  this 
technology  may  be  adequate  for  tanker- 
transport  -bomber  applications ,  it  does 
not  satisfy  tactical  fighter  training 
needs.  Modern  fighter-attack  aircraft 
are  characterized  by  cockpits  which  at¬ 
tempt  to  maximize  the  out-of-the-window 
view  of  the  pilot.  This  wide-field- 
of-view  requirement,  when  coupled  with 
the  need  to  detect  and  determine  target 
aspects  at  great  distances,  places  ex¬ 
treme  demands  on  the  visual  system 


System  requirements  and  engineering 
feasibility  studies  should  be  completed 


because  high  resolution  and  wide  field 
of-view  are  incompatible  from  a  design 
standpoint.  Consequently,  there  is  a 
need  to  develop  technology  that  will 
support  the  tactical  flying  mission. 
Secondly,  knowledge  concerning  the  de¬ 
gree  of  realism  required  for  effective 
training  in  this  area  is  still  impre¬ 
cise.  Although  perfect  realism  may  be 
a  desired  goal  from  the  pilot's  view¬ 
point,  it  is  also  very  expensive.  R&D 
is  needed  to  determine  the  effects  of 
reduced  realism  and  thereby  specify 
those  levels  of  realism  necessary  for 
the  most  effective  pilot  training  pos¬ 
sible. 

This  program  will  benefit  two  areas. 
Since  there  are  continuing  advances  in 
technology,  it  is  likely  that  image 
generation  systems  will  be  developed 
that  will  produce  imagery  which  ap¬ 
proaches  real-world  fidelity.  The  de¬ 
velopment  of  photo-based  systems  will 
provide  real-world  imagery  since  they 
will  be  based  upon  actual  photographs. 
Display  technology  will  also  mature, 
thus  enabling  both  high  resolution  and 
wide  f ield-of-view.  Moreover,  it  is 
expected  that  these  systems  will  be 
affordable,  thus  allowing  the  implemen¬ 
tation  of  such  systems  on  operational 
tactical  flight  simulators.  Ongoing 
R&D  will  provide  answers  to  the  issue 
of  fidelity.  Such  data  will  provide 
the  specifications  for  the  minimum  re¬ 
quirements  for  effective  training. 
These  data  will  be  of  direct  benefit 
to  the  Simulator  System  Program  Office 
in  their  acquisition  programs. 

To  develop  the  requisite  visual  systems 
technology  base,  AFHRL  has  driven  the 
industry  in  the  image  generation  arena 
and  has  pursued  a  host  of  display  tech¬ 
nologies.  The  Advanced  Visual  Technol¬ 
ogy  System  (AVTS)  has  been  developed  to 
provide  a  flexible  Image  Generation 
(IG)  R&D  tool  which  is  capable  of  sup¬ 
porting  a  variety  of  display  system 
configurations.  The  Visual  System 
Component  Development  Program  (VSCDP) 
was  also  developed,  along  with  AVTS, 
to  demonstrate  a  Limited-Field-of-View 
(LFOV)  dome  capable  of  supporting  heli¬ 


copter  Nap-of-the-Earth  (NOE)  missions. 
To  provide  the  considerable  LFOV  and 
high  acuity  for  visual  displays  neces¬ 
sary  to  simulate  weapon  systems  such 
as  the  F-15  and  F-16,  a  Full-Field-Of- 
View  Dome  (FFOVD)  will  be  developed. 
Another  approach  is  taken  by  the  Fiber- 
Optic  Helmet-Mounted  Display  (FOHMD), 
which  addresses  the  need  for  a  low- 
cost,  transportable,  simulator  by  de¬ 
veloping  a  head-  and  eye-tracked,  high- 
resolution,  area-of-interest ,  stereo¬ 
scopic,  high-brightness,  infinity  dis¬ 
play  system.  Highly  cost-effective  and 
visual-system-matched  results  also  ap¬ 
pear  obtainable  using  a  Variable  Acuity 
Projection  System  as  the  technological 
leverage  for  the  Fighter  Lead-In  Train¬ 
er  (FLIT)  program. 

Both  the  AVTS  and  VSCDP  programs  have 
completed  their  development  and  accept¬ 
ance  cycles;  additional  work  will  be 
system  enhancements  aimed  at  providing 
a  more  complete  or  effective  R&D  tool. 
The  FFOVD  system  is  nearly  under  con¬ 
tract  and  should  provide  an  R&D  tool 
in  the  FY89  time  frame.  The  FOHMD  pro¬ 
gram  has  already  provided  a  head-track- 
ed-only,  interim  system  to  research  the 
salient  psychophysical  issues.  This 
is  being  followed  by  the  engineering 
prototype  head-  and  eye-tracked  system 
scheduled  for  the  fourth  quarter  of 
FY88.  The  FLIT  program  will  soon  be 
under  contract  and  should  provide  a 
system  by  the  end  of  FY88. 

In  the  area  of  training  effectiveness, 
a  number  of  efforts  have  been  completed 
and  others  have  been  planned  and  are 
underway.  Completed  efforts  include: 
a  comparison  of  tradeoffs  between  col¬ 
limated  and  real  imagery;  contrasted 
sensitivity  effects  at  low  luminance 
levels;  effects  of  brightness  and  con¬ 
trast  on  target  identification;  and  the 
effects  of  varying  levels  of  scene  on 
approach/landing  performance. 

Contact:  Dr.  Wayne  L.  Waag 

AFHRL/ OTU 

Williams  AFB,  AZ  85240-6547 

Commercial  (602)  988-6561 

AUTOVON  474-6561 


WARNET 


WARNET 


The  objective  of  the  WARNET  program  is 
to  design  and  demonstrate  an  interac¬ 
tive  network  of  low-cost  combat  simula¬ 
tors  to  include  the  F-15  air-to-air 
mission  and  the  F-16  air-to-ground 
mission.  The  benefits  of  a  network  of 
flight  simulators  would  provide  a  most 
necessary  supplement  to  those  aspects 
of  training  not  possible  in  current 
flying  exercises,  and  allow  much  more 
frequent  practice  of  those  skills  need¬ 
ed  to  handle  peak  combat  workloads 
without  saturation.  The  result  would 
be  a  higher  chance  of  survival  in  real 
combat. 


Once  WARNET  is  developed,  nodes  could 
be  established  at  every  Air  Force 
fighter  squadron  in  the  world.  Each 
node  would  contain  a  four-ship  simula¬ 
tor.  A  nearby  node  might  be  challenged 
for  4  versus  4  combat;  or  a  major  area 
of  the  network  might  be  activated  for 
large-scale  practice.  Full-scale  air 
war  exercises  involving  many  nodes  and 
one  hundred  simulators/pilots  could 
be  scheduled  on  a  regular  basis.  In 
times  of  potential  national  emergency, 
special  missions  might  be  flown  several 
times  in  dress  rehearsal  with  all  the 
players  exposed  to  the  expected  threats 
over  the  battle  terrain. 


An  initial  technical  feasibility  and 
mission  requirements  study  has  started 
this  year  and  will  be  concluded  in 
February  1987.  Using  these  results, 
the  Laboratory  will  launch  a  three- 
phased  program.  Phase  I  consists  of 
three  separate  local  area  networks 
(LANs)  of  F-15  and  F-16  simulators. 
One  F-16  four-ship  and  one  F-15  four- 
ship  will  consist  of  both  high-  and 
medium-fidelity  simulations.  The  third 
LAN  will  consist  of  eight  F-16  air-to- 
air  part-task  trainers  developed  in 
conjunction  with  the  Air  National 
Guard.  Adversary  consoles  will  be 
added  to  each  LAN  as  required  for  mis¬ 
sion  training.  This  wide  range  of 
devices  will  allow  us  to  address  the 
fidelity  versus  training  question,  as 
well  as  to  conduct  research  into  team/ 
situational  awareness  training  as  we 
transition  into  Phase  II. 


Phase  II  is  projected  for  completion  in 
FY93.  In  this  phase,  we  will  network 
each  of  the  LANs  together  for  true 
force-on-force  capability.  We  will 
also  Incorporate  a  command  and  control 
node  to  provide  a  more  realistic  war¬ 
time  environment.  Situational  aware¬ 
ness  research  becomes  a  major  effort 
in  this  phase  as  we  stress  both  deep- 
strike  and  area  defense  scenarios. 
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Phase  III  Is  aimed  at  large-scale  war- 
gaming  efforts.  By  expanding  the  net¬ 
work  and  providing  the  logistics  and 
command  features,  we  approach  realistic 
theater-wide  combat  dynamics.  With 
this  tool,  we  have  the  ability  to 
investigate  all  aspects  of  combat 
training. 

Contact:  Ms.  Rebecca  Brooks 

AFHRL/OTE 

Williams  AFB,  A Z  85240-6457 

Commercial  (602)  988-6561 

AUTOVON  474-6561 

Aircrew  Training  Branch 

The  Aircrew  Training  Branch  (OTA)  is 
primarily  responsible  for  managing,  up¬ 
dating,  maintaining,  and  operating  the 
major  simulation  facilities  located  at 
Williams  AFB,  Arizona.  These  facilities 
provide  the  foundation  for  research  and 
development  on  training  effectiveness 
and  flight  simulator  engineering.  The 
simulation  systems  include  dome,  dodec¬ 
ahedron,  and  helmet-mounted  visual 
displays;  computer  image  generation 
systems;  and  related  R&D  equipment. 
They  are  capable  of  simulating  F-16A, 
F-16C,  and  A-10  aircraft.  These  simu¬ 
lation  systems  support  all  R&D  conduct¬ 
ed  under  Project  1123,  Flying  Training 
Development,  and  Project  6114,  Flight 
Simulation  Technology,  as  well  as  R&D 
conducted  under  Program  Element  63227F, 
Advanced  Simulator  Technology,  and  thus 
provide  the  primary  simulation  capabil¬ 
ity  for  implementing,  demonstrating, 
and  testing  training  technology  and 
simulation  hardware  advancements. 

The  major  projects  supported  by  the 
Branch  are  documented  in  the  previous 
descriptions  for  Projects  1123,  2363, 

2743,  and  6114.  However,  there  are 
several  other  noteworthy  Branch  activi¬ 
ties.  These  activities  center  around 
the  implementation  of  new  technologies 
to  enhance  simulation  performance. 

One  of  the  Division’s  primary  research 
systems  is  the  F-16A  simulator.  This 
system  simulates  an  F-16A  Block  15S  us¬ 


ing  an  LFOV  Dome  display  and  the  AVTS 
computer  image  generator.  In  order  to 
provide  a  more  realistic  simulation, 
several  enhancements  are  being  made  to 
this  system.  First,  cell  texturing  is 
being  added  to  the  AVTS  imagery  shown 
in  the  dome.  This  will  provide  a  capa¬ 
bility  for  higher-density  scene  con¬ 
tent  for  use  in  low-altitude  training. 
Also,  the  basic  side  computer  system 
is  being  upgraded  to  include  a  Distrib¬ 
uted  Microprocessing  System  (DMS).  The 
DMS  will  allow  us  to  collocate  computer 
equipment  with  the  cockpit  or  other 
research  hardware,  thus  reducing  trans¬ 
port  delay  and  providing  a  more  realis¬ 
tic  simulation.  In  addition,  it  will 
allow  the  writing  of  modular,  generic 
software  that  can  be  transported  to 
other  systems  as  needed. 

The  other  major  enhancement  planned  for 
the  Division's  simulation  systems 
involves  the  in-house  development  of  a 
new  Instructor  Operator  Station  (IOS). 
The  IOS  is  being  developed  to  replace 
the  existing  F-16A  and  A-10  IOS.  The 
new  IOS  will  be  low-cost,  dual-ship  ca¬ 
pable,  and  able  to  run  training  mis¬ 
sions  and  collect  data  for  R&D  pro¬ 
jects.  The  ~0S  will  be  based  upon  a 
distributed  microprocessing  system, 
thus  permitting  further  evaluation  of 
this  technology. 

Contact:  Capt  Vickie  Marshman 

AFHRL/OTA 

Williams  AFB,  A Z  85240-6547 

Commercial  (602)  988-6561 

AUTOVON  474-6561 

Combat  Mission  Trainer 

The  combat  missions  of  today' s  Air 
Force  pilots  are  becoming  ever  more  de¬ 
manding.  This  is  due  to  Increased 
weapon  system  complexity,  deadlier 
threats,  and  increased  speeds.  The  in¬ 
formation  that  must  be  processed  by  the 
pilot  is  overwhelming.  In  order  to 
survive,  let  alone  succeed  in  this  en¬ 
vironment,  a  pilot  must  perform  almost 
flawlessly.  To  reach  this  goal,  he 
must  practice,  and  practice  frequently. 


Unfortunately,  there  is  no  existing  way 
to  provide  realistic  training,  with 
actual  threats  and  valid  targets,  with¬ 
out  imperiling  the  safety  of  pilots, 
on  a  recurring  schedule  that  will  allow 
maintenance  of  proficiency. 

The  objective  of  the  Combat  Mission 
Trainer  (CMT)  program  is  to  faithfully 
simulate  this  tactical  combat  environ¬ 
ment  in  order  to  provide  valid  training 
without  the  loss  of  life  or  equipment. 
The  CMT  will  permit  our  pilots  to  have 
the  capability  to  train  and  rehearse 
missions  in  the  realistic  world  of  air 
and  ground  threats  over  simulated  en¬ 
emy  territory. 

In  the  CMT,  the  minimum  tactical  con¬ 
figuration  will  require  the  simulation 
of  two-ship  missions  in  the  context  of 
a  hostile-threat  environment.  Several 
flight  simulation  technologies  are  be¬ 
ing  developed  and  integrated.  The  aer¬ 
odynamic  characteristics,  the  cockpit, 
the  offensive  and  defensive  weapon  sys¬ 
tems,  and  the  supporting  sensor  systems 
will  be  provided  for  two  F-16  aircraft 
simulators.  High-resolution,  360-de- 
gree,  out-of-cockpit  color  displays, 
and  their  associated  visual  scenes  and 
sensor  imagery  (infrared,  radar,  etc.), 
will  also  be  provided  (see  Fiber-Optic 
Helmet-Mounted  Display  and  Advanced 
Visual  Technology  System  descriptions 
above).  Communication,  command  and 
control  functions,  hostile  threats,  and 


responsive  electronic  warfare  will  all 
be  included  in  this  realistic  combat 
simulation.  This  raulticockpit ,  multi¬ 
sensor  simulation  will  utilize  an  In¬ 
structor  Operator  Station  to  keep  track 
of  and  control  the  highly  complex  sit¬ 
uations  and  allow  the  instructors  to 
remain  adequately  informed.  Finally, 
networking  will  allow  each  simulator 
to  interact  with  the  others. 

All  of  these  technologies  are  being  de¬ 
veloped  either  at  the  Operations  Train¬ 
ing  Division  or  at  other  laboratories 
within  the  Air  Force  Systems  Command. 
Planning  has  been  outlined,  and  imple¬ 
mentation  has  begun.  The  first  ship 
will  be  fully  operational  by  the  first 
quarter  of  1988.  The  second  ship,  with 
refined  and  miniaturized  components, 
will  be  running  by  the  fourth  quarter 
of  1988.  The  two-ship,  interactive 
simulation  will  be  demonstrated  during 
the  first  quarter  of  1989.  Follow-up 
efforts  for  more  advanced,  transport¬ 
able  systems  will  start  in  late  1988, 
with  a  completion  date  of  the  fourth 
quarter  of  1992.  The  task  for  the  Com¬ 
bat  Mission  Trainer  program  is  to  inte¬ 
grate  and  package  these  technologies 
into  an  effective  training  device. 

Contact:  Capt  John  A.  Brunderman 

AFHRL/OTE 

Williams  AFB,  AZ  85240-6457 

Commercial  (602)  988-6561 

AUTOVON  474-6561 


LOGISTICS  AND  HUMAN  FACTORS  DIVISION 


such  as  logistics,  command /control ,  and 
space  operations. 


Colonel  Donald  C.  Tetmeyer 
Division  Chief 


The  hardware  capabilities  to  store 
data  are  increasing  at  an  exponential 
rate.  However,  more  data  does  not 
necessarily  mean  more  useful  informa¬ 
tion.  Too  often  processes  have  been 
automated  at  considerable  cost,  only 
to  find  that  they  will  then  take  long¬ 
er,  require  more  people,  and  produce 
results  that  are  less  reliable.  To  be 
effective  and  efficient,  a  system  must 
be  designed  so  people  can  quickly  get 
just  the  right  information  they  need 
for  the  immediate  decision  or  job,  even 
if  they  do  not  always  know  exactly  what 
that  information  is.  This  requires  new 
methods  of  interfacing  computers  and 
neutral  exchange  among  databases;  new 
methods  of  data  structuring,  configu¬ 
ration  management  and  control;  new 
methods  of  decision  aiding,  modeling 
and  analysis;  basic  understanding  of 
human  and  computer  processing  capabil¬ 
ities  to  get  the  best  of  both;  and 
methods  for  displaying  information 


The  Logistics  and  Human  Factors  Divi¬ 
sion  holds  a  unique  place  in  the  Air 
Force  Laboratory  system.  As  implied 
by  our  title,  we  are  developing  essen¬ 
tial  technology  for  the  Air  Force 
infrastructure,  as  opposed  to  hardware 
for  weapon  systems.  We  are  developing 
technology  to  enhance  the  performance 
of  people  doing  critical  Air  Force 
jobs.  Our  field  of  endeavor  is  infor¬ 
mation  and  decision  support. 

This  Division,  with  its  unique  mission, 
is  a  relative  newcomer  to  the  Labora¬ 
tory  system.  It  was  formed  in  a  1980 
internal  reorganization  of  the  Air 
Force  Human  Resources  Laboratory,  and 
did  not  obtain  a  funded  6.3  Program 
Element  until  1984.  During  this  short 
time,  it  already  has  had  a  significant 
impact  on  the  direction  of  future  Air 
Force  logistics  automation.  This  new 
organization  recognized  the  rapid 
growth  of  computer  technology  and  its 
applications  throughout  the  Air  Force, 
especially  in  infrastructure  functions 
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such  that  it  is  most  rapidly,  easily, 
and  correctly  understood.  R&D  underway 
covers  a  spectrum  from  human  informa¬ 
tion  processing  to  the  use  of  artifi¬ 
cial  intelligence  to  organize  data¬ 
bases.  Much  of  this  cybernetic  tech¬ 
nology  is  still  in  its  infancy. 

The  Logistics  and  Human  Factors  Divi¬ 
sion  has  a  broad  program  ranging  from 
fundamental  research  through  advanced 
development,  to  meet  operational  needs 
into  the  Air  Force  2000  environment. 
The  Division  staff  is  interdisciplinary 
in  computer  science,  human  factors, 
operations  research,  and  engineering. 
Work  is  performed  by  interdisciplinary 
teams  organized  to  address  four  criti¬ 
cal,  automation-sensitive  Air  Force 
functional  areas:  base-level  combat 
maintenance,  logistics  planning  for 
wartime,  command /cont ro 1 ,  and  the  sys¬ 
tems  design  and  acquisition  process. 
This  internal  functional  organization 
of  the  Division  recognizes  that  the 
results  of  information  and  decision 
sciences  must  be  implemented  by  people 
who  are  already  doing  these  functions 
and  that  these  people  are  an  enormous 
resource  of  expert  functional  knowl¬ 
edge.  Potential  users  are  closely 
involved  from  the  outset  to  assure  that 
the  technology  development  stays  rele¬ 
vant,  and  to  build  the  confidence  that 
is  so  important  for  eventual  successful 
implementation.  Experienced  logistics 
and  command /control  officers  are 
included  in  advanced  development  pro¬ 
ject  teams,  and  prototypes  are  tried 
in  the  operating  environment.  The  test 
of  any  new  information/decision  support 
concept  is  whether  it  really  enables 
people  to  do  the  job  better. 

Combat  Logistics  Branch  (LRC) 

The  objective  of  the  R&D  in  the  Branch 
is  to  improve  the  readiness  and  capa¬ 
bility  of  maintenance  and  logistics 
units  to  sustain  the  required  sorties 
in  any  combat  environment.  There  are 


tenance  through  advanced  job  aids  and 
diagnostics;  and  techniques  to  improve 
combat  maintenance  assessment,  readi¬ 
ness,  and  sustainability. 

Even  in  the  best  of  peacetime  worlds, 
the  Air  Force  often  has  difficulty  pro¬ 
viding  enough  highly  skilled  techni¬ 
cians  to  maintain  the  hardware.  Expe¬ 
rience  levels  have  fallen  in  some  crit¬ 
ical  skills,  aggravating  the  conflict¬ 
ing  time  demands  of  meeting  the  flying 
schedule  and  providing  adequate  train¬ 
ing.  Shortages  of  qualified  experi¬ 
enced  technicians  not  only  impact  the 
quality  of  peacetime  maintenance  but, 
more  importantly,  severely  impact  the 
readiness  of  maintenance  organizations 
to  produce  sorties  in  the  much  tougher 
combat  environments  of  dispersed  main¬ 
tenance  sites,  austere  bases,  and  mo¬ 
bile  maintenance  teams.  The  require¬ 
ment  to  perform  maintenance  tasks  under 
combat  conditions  imposes  additional 
demands  due  to  chemical  warfare,  Air¬ 
craft  Battle  Damage  Repair  (ABDR),  and 
combat  stress. 

Branch  R&D  is  focused  on  improving  the 
capability  for  intermediate-  and  orga¬ 
nizational-level  maintenance  in  various 
combat  environments  (especially  dis¬ 
persed  basing),  including  the  immediate 
interfaces  with  the  base-level  logis¬ 
tics  functions  such  as  supply,  cargo 
handling,  fuels,  and  transportation. 
The  various  planning,  assessment, 
training,  personnel,  management,  and 
technical  support  processes  that  impact 
performance  of  the  base-level  mainte¬ 
nance  function  are  of  particular  inter¬ 
est.  This  scope  includes  the  develop¬ 
ment  of  new  hardware  and  software  sys¬ 
tems  that  encompass  the  whole  base- 
level  maintenance  function,  and  yet  is 
narrow  enough  to  permit  a  concentration 
on  human  performance  issues  that  may 
limit  the  ability  to  do  tasks  that  must 
be  accomplished  in  a  combat  environ¬ 
ment. 

Variables  that  will  be  considered  and 


two  major  concentrations:  improving  possibly  impacted  as  a  result  of  this 

the  technical  capability  to  do  main-  R&D  include  training  requirements  and 


training  evaluation;  job/task  require¬ 
ments,  procedures,  and  evaluation;  per¬ 
sonnel  skills,  qualification,  and  expe¬ 
rience;  maintenance  concepts,  manage¬ 
ment  procedures,  and  systems;  design 
and  maintenance  of  weapon  systems  and 
support  equipment;  personnel  utiliza¬ 
tion  and  scheduling;  organizational 
structure  and  management;  maintenance 
policy  and  planning;  technical  orders; 
maintenance  prioritization  and  the 
decision-making  process;  maintenance 
readiness,  capability  assessment,  and 
sustainability  prediction;  personnel 
stress  and  fatigue;  aircraft  battle 
damage  repair;  and  the  impact  of  the 
chemical/biological  warfare  environment 
on  organizational  performance.  Tradi¬ 
tional  measures  of  task  performance, 
such  as  time  to  perform,  type  and  num¬ 
ber  of  errors  made,  skills  required, 
and  problems  encountered  will  be  used 
to  evaluate  R&D  efforts.  In  addition, 
subjective  data  on  attitudes,  morale, 
and  preferences  will  be  collected  where 
appropriate.  System  performance  meas¬ 
ures  will  be  used  during  field  evalua¬ 
tions.  These  include  sorties  scheduled 
and  flown,  aborts,  cancellations,  hours 
flown,  retest  OK  and  cannot  duplicate 
rates,  and  aircraft  status  designa¬ 
tions  . 

Advanced  information  science  and  com¬ 
puter  technology  are  being  used  to  help 
"bridge  the  gap"  between  the  technical 
skill  available  and  the  skill  required 
to  maintain  today's  sophisticated  air¬ 
craft  and  the  broader  skills  required 
of  maintenance  generalists  in  the  fu¬ 
ture.  The  basic  approach  is  to  use 
computer  technology  to  give  technicians 
more  thorough,  easily  followed,  and  re¬ 
sponsive  maintenance  instructions  and 
troubleshooting  aids.  These  will  be 
developed  in  a  phased,  incremental  pro¬ 
gram.  The  first  step  was  the  develop¬ 
ment  of  principles  for  electronic  dis¬ 
play  of  job  aiding  information,  and  the 
test  of  two  approaches  in  Strategic  Air 
Command  (SAC)  intermediate  shops.  The 
second  step  is  a  portable  computer  dis¬ 
play  system  for  a  Tactical  Air  Command 
(TAC)  flight  line.  The  third  increment 


will  incorporate  interactive  diagnos¬ 
tics  and  interface  with  sensors  and 
computers  on  board  the  aircraft.  Fu¬ 
ture  increments  will  provide  a  single 
communications  link  to  all  base-level 
maintenance  data  and  artificial  intel¬ 
ligence  aids. 

Integrated  Maintenance  Information 
System  (IMIS) 

Changes  in  threats,  support  concepts, 
and  weapon  system  technology  are  taking 
place  which  will  radically  alter  the 
way  maintenance  must  be  done  to  gener¬ 
ate  tactical  sorties  in  future  wars. 
Aircraft  must  be  more  dispersed.  They 
must  depend  less  on  bulky  test  equip¬ 
ment  and  large  on-site  facilities  for 
off-equipment  maintenance.  Modular 
architecture  design  concepts  will  make 
existing  maintenance  specialties  obso¬ 
lete.  Systems  will  be  more  complex, 
more  integrated,  and  require  deeper 
maintenance  on  the  line  by  fewer  tech¬ 
nicians  who  must  master  a  broader  range 
of  tasks  and  skills.  Automation  will 
only  increase  the  problem  if  introduced 
as  a  multiplicity  of  unique  and  incom¬ 
patible  information  "aids."  AFHRL  is 
developing  a  comprehensive  information 
and  job  aiding  system  to  help  techni¬ 
cians  generate  the  needed  sorties  in 
this  environment. 

The  IMIS  will  consist  of  a  portable 
computer  for  flight  line  use,  an  air¬ 
craft  interface  panel  for  interacting 
with  aircraft  systems,  and  a  worksta¬ 
tion  for  use  in  the  shop  when  not  re¬ 
motely  deployed.  The  system  will  pro¬ 
vide  the  technician  with  direct  access 
to  several  maintenance  information  sys¬ 
tems  and  databases  including  automated 
technical  data,  automated  maintenance 
management  information,  the  computer- 
aided  training  system,  and  automated 
parts  information  and  ordering.  IMIS 
will  process,  integrate,  and  display 
maintenance  information  to  the  techni¬ 
cian.  The  system  will  display  graphic, 
technical  instructions,  provide  intel¬ 
ligent  diagnostic  advice,  provide 
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aircraft  battle  damage  assessment  aids, 
analyze  in-flight  performance  and  fail¬ 
ure  data,  analyze  aircraft  historical 
data,  and  access  and  interrogate  on¬ 
board  built-in  test  capabilities.  It 
will  also  provide  the  technician  with 
easy,  efficient  methods  to  receive  work 
orders,  report  maintenance  actions, 
order  parts  from  supply,  and  complete 
computer-aided  training  lessons  and 
simulations.  The  portable  computer  will 
make  it  possible  to  present  quality 
information  by  taking  advantage  of  the 
computer's  ability  to  interact  with 
and  tailor  information  to  the  immedi¬ 
ate  needs  of  technicians  with  varying 
levels  of  expertise. 

Development  is  proceeding  in  three 
stages,  using  significant  amounts  of 
in-house  technology  development  supple¬ 
mented  by  contracts.  Stage  I,  the 
Computer-based  Maintenance  Aids  System 
(CMAS) ,  established  basic  requirements 
for  automated  Technical  Order  (TO)  data 
content,  presentation  formats,  and 
basic  delivery  system  hardware/soft¬ 
ware.  Stage  II,  the  Portable  Computer- 


based  Maintenance  Aids  System  (PCMAS), 
is  designed  to  examine  the  TO  presenta¬ 
tion  specified  in  Stage  I  on  the  flight 
line  and  demonstrate  interactive  diag¬ 
nostics  and  aircraft  battle  damage 
repair  assessment.  Stage  III,  Full 
IMIS  Demonstration,  will  extend  the 
concepts  specified  in  Stages  I  and  II, 
with  an  emphasis  on  information  inte¬ 
gration  throughout  the  maintenance 
complex. 

In  Stage  I,  a  prototype  automated  tech¬ 
nical  data  system  was  tested  in  inter¬ 
mediate-level  maintenance.  The  proto¬ 
type  was  used  to  successfully  demon¬ 
strate  the  feasibility  and  desirability 
of  automated  storage  and  presentation 
of  technical  data.  The  prototype  sys¬ 
tem  was  well  received  by  technicians, 
who  strongly  recommended  its  applica¬ 
tion  by  the  Air  Force.  Draft  function¬ 
al  specifications  for  the  system  and 
for  the  content  of  technical  data  to 
be  presented  on  the  system  were  devel¬ 
oped.  A  major  technical  advancement 
has  been  made  with  the  in-house  devel¬ 
opment  of  an  Authoring  and  Presentation 
System  (APS)  to  generate,  store,  orga¬ 
nize,  retrieve,  and  display  technical 
order  information.  APS  uses  a  rela¬ 
tional  database  to  identify  and  store 
all  the  critical  data  relationships 
found  in  a  TO.  It  is  format  free  and 
machine  and  application  independent. 
APS  will  make  both  present  and  future 
electronic  TO  display  systems  more 
flexible,  transportable,  and  powerful. 
Stage  II,  the  PCMAS,  is  a  follow-on 
advanced  development  R&D  effort  to 
apply  the  technology  developed  in  Stage 
I  to  the  flight  line  environment.  A 
small,  portable,  special-purpose  com¬ 
puter  is  being  developed  for  use  on 
the  flight  line.  Field  tests  with 
PCMAS  will  examine  problems  involved 
in  using  a  portable  computer  system  on 
the  flight  line.  The  PCMAS  will  demon¬ 
strate  several  concepts  that  are  key 
to  the  successful  implementation  of 
IMIS.  In  addition  to  presenting  tech¬ 
nical  data  for  routine  maintenance 
tasks,  PCMAS  will  provide  an  inter¬ 
active  diagnostics  capability. 
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The  PCMAS  device  will  plug  directly  in¬ 
to  the  aircraft  system  bus,  take  over 
as  bus  controller,  interrogate  on-board 
systems  for  stored  fault  data,  and  run 
manual  and  built-in  tests.  Efficient 
testing  procedures  will  be  generated 
through  generic  diagnostic  software 
that  ensures  optimal  use  of  tests  based 
on  their  run  times  and  fault  coverage. 
The  software  also  examines  diagnostic 
factors  such  as  maximum  aircraft  down¬ 
time  and  available  supplies.  Also,  the 
PCMAS  will  provide  specialized  techni¬ 
cal  information  to  assist  in  ABDR 
assessment.  This  information  will 
allow  a  single  technician  to  accomplish 
the  assessment  task  so  that  specialists 
in  each  area  (structural,  airplane 
general,  and  electrical)  are  not 
required.  In  Stage  III,  the  full  IMIS 
capability  will  be  developed  and  demon¬ 
strated.  Hardware  and  software  will 
be  developed  to  integrate  the  various 
maintenance  information  systems  with 
which  technicians  must  interact  daily. 
The  technician's  primary  interface  with 
IMIS  will  be  an  extremely  portable, 
battery-powered  computer  that  is  rugged 
enough  for  flight  line  use.  A  library 
of  removable  memory  cartridges  will 
store  all  the  technical  order  informa¬ 
tion  and  diagnostic  aids  needed  for  one 
weapon  system.  The  portable  computer 
will  have  the  processing  power  to 
quickly  display  complex  graphics  and 
provide  rapid  response  to  the  techni¬ 
cian's  requests.  Interactive  trouble¬ 
shooting  routines  and  artificial- 
intelligence-based  diagnostic  aids  will 
provide  advice  for  difficult  fault 
isolation  problems. 

IMIS  will  have  many  benefits.  It  will 
optimize  the  use  of  the  available  man¬ 
power,  enhance  technical  performance, 
improve  training,  and  reduce  the  sup¬ 
port  equipment  and  documentation  needed 
for  deployment.  It  will  serve  as  the 
technician's  single,  integrated  source 
of  all  the  technical  information  re¬ 
quired  to  perform  modern  aircraft  main¬ 
tenance.  This  will  eliminate  the  need 
for  the  technician  to  learn  how  to  use 
several  different  computer  systems, 


thereby  reducing  training  requirements 
and  eliminating  confusion.  It  may 
also  eliminate  the  need  for  the  Air 
Force  to  field  several  different  com¬ 
puter  systems;  thus  reducing  the  need 
for  unique  hardware  and  software. 
Significant  cost  savings  will  be  real¬ 
ized  from  the  reduced  training  and 
system  acquisition  requirements.  In 
addition,  the  improved  diagnostic  cap¬ 
abilities  will  improve  the  efficiency 
of  technicians  to  troubleshoot  faults, 
resulting  in  savings  in  time  to  restore 
malfunctioning  equipment  to  operational 
status,  reduced  consumption  of  spare 
parts,  and  improved  operational  readi¬ 
ness  rates.  Finally,  the  ability  to 
collect  historical  maintenance  diagnos¬ 
tics  data  will  allow  the  identification 
of  common  field  problems  that  might 
indicate  flaws  in  the  TO  data,  incor¬ 
rect  procedures,  and/or  areas  which 
require  additional  training  for  the 
maintenance  personnel. 

Progress  to  date  is  as  follows:  Stage 

I,  CMAS,  has  been  completed.  The  Stage 

II,  PCMAS,  has  been  designed  and  an 
initial  unit  fabricated.  The  system 
and  software  will  be  tested  in  1987. 
The  Stage  III,  full-scale  development 
of  IMIS,  will  be  accomplished  under 
contract,  with  award  planned  for  late 
FY87. 

Contact:  Capt  Joe  Von  Holle 
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Effects  of  Chemical  Warfare  Defense  on 
Airbase  Maintenance  Operations 

The  ability  of  maintenance  personnel 
to  perform  critical  and  highly  techni¬ 
cal  tasks  in  chemical  warfare  gear  has 
been  recognized  as  a  potentially  limit¬ 
ing  factor  in  the  generation  of  combat 
sorties.  No  systematic,  scientific 
data  have  been  gathered  on  the  effects 
that  chemical  protective  clothing  may 
have  on  performing  the  maintenance 
tasks  that  will  be  required  when  the 


aircraft  requires  troubleshooting  and 
reaoval /replacement  of  various  systems 
and  components.  Until  this  information 
is  known,  the  actual  degree  of  limita¬ 
tion  imposed  by  chemical  warfare  on 
maintenance  tasks  cannot  be  predicted. 
Consequently,  a  methodology  must  be 
developed  and  data  collected  to  system¬ 
atically  evaluate  the  impact  chemical 
warfare  gear  has  on  the  performance  of 
critical  maintenance,  diagnostic,  and 
repair  tasks  in  order  to  assess  wartime 
capability  and  provide  the  basis  for 
developing  improved  equipment  and  pro¬ 
cedures. 

AFHRL/LRC  is  developing  this  method¬ 
ology.  It  can  be  used  by  operational 
personnel  as  well  as  R&O  personnel. 
The  methodology  will  be  applied  to 
selected  critical  maintenance  tasks  on 
the  F-16  to  evaluate  the  impact  of  the 
chemical  defense  gear  on  the  ability 
of  technicians  to  perform  selected 


critical  tasks.  The  methodology  will 
be  used  to  collect  data  at  a  tactical 
F-16  wing  in  Europe.  The  resultant 
data  will  be  analyzed  to  develop  main¬ 
tenance  workarounds,  recommendations 
for  tool  redesign,  or  procedural 
changes  that  can  reduce  the  expected 
negative  impact  of  the  chemical  gear 
on  task  performance.  In  addition, 
results  from  this  effort  will  provide 
data  for  use  by  the  Armstrong  Aerospace 
Medical  Research  Laboratory  (AAMRL), 
which  is  modeling  the  impact  of  chem¬ 
ical  warfare  on  combat  operations. 

The  effort  started  with  an  in-house 
analysis  to  determine  which  combat 
critical  tasks  should  be  studied.  A 
thorough  review  of  maintenance  data 
collection  records  was  conducted  and 
appropriate  tasks  selected.  A  review 
of  the  applicable  TO  and  job  guides 
was  also  accomplished. 


Based  on  these  reviews,  data  recording 
forms  were  developed  to  use  in  conjunc¬ 
tion  with  video  recording  to  capture 
the  types  of  problems  that  arise  when 
maintenance  is  performed  in  the  chem¬ 
ical  ensemble.  The  methodology  was 
developed  and  tested  at  a  CONUS  base 
during  the  3rd  quarter  of  FY86. 

Upon  completion,  this  effort  will 
provide  a  tested  methodology  to  permit 
maintenance  organizations  to  evaluate 
their  ability  to  perform  critical 
combat  maintenance  tasks  while  wearing 
the  chemical  defense  gear.  This  will 
provide  a  basis  for  them  to  develop 
ways  to  more  effectively  perform  tasks 
which  are  severely  impacted  by  the  use 
of  the  gear.  The  improved  procedures 
will  increase  the  unit's  capability  to 
conduct  combat  operations  under  chemi¬ 
cal  warfare  conditions. 

The  performance  measurement  and  data 
collection  methodologies  have  been 
developed  and  tested  at  Shaw  AFB.  In 
October  1986,  these  methodologies  were 
applied  during  data  collection  for 
selected  critical  F-16  maintenance 
tasks  at  Hahn  AB,  Germany. 

Contact:  Capt  Alan  Deibel 

AFHRL/LRC 

Wright-Patterson  AFB,  OH  45433 
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Combat  Maintenance  Capability  (CMC) 

To  ensure  that  the  Air  Force  has  the 
capability  to  meet  its  mission  require¬ 
ments,  it  is  essential  to  have  effec¬ 
tive  ways  to  estimate  its  capability 
to  conduct  wartime  operations  and  to 
sustain  these  operations.  Ways  are 
needed  to  accurately  estimate  the  cap¬ 
abilities  of  individual  units  and  to 
estimate  the  logistics  support  required 
so  that  the  units  can  accomplish  their 
assigned  missions.  Extensive  work  has 
been  accomplished  to  develop  techniques 
to  measure  capabilities  under  peacetime 
conditions  and  to  estimate  logistics 


requirements  for  peacetime  operations. 
However,  additional  work  is  needed  to 
extend  these  capabilities  to  effec¬ 
tively  include  the  unique  requirements 
of  wartime  operations.  The  CMC  project 
was  undertaken  to  meet  this  need. 

The  CMC  project  initially  used  Hahn  AB, 
Germany  as  an  evaluation  site  and  the 
F-16  aircraft  as  an  analysis  vehicle. 
CMC  objectives  were  to  develop  method¬ 
ology,  analyze  current  maintenance 
processes,  identify  combat  impacts,  and 
recommend  improvements.  The  approach 
used  existing  Air  Force  Logistics  Com¬ 
posite  Model  (LOCM)  data  sets,  war 
plans,  and  resource  quantities.  Sur¬ 
veys  were  used  to  capture  expected  com¬ 
bat  impacts  and  updates  to  task  times 
and  crew  sizes.  This  initial  work  was 
followed  by  a  refinement  of  the  method¬ 
ology  and  an  extensive,  highly  success¬ 
ful  application  demonstration  at  RAF 
Lakenheath,  UK,  with  the  F-111F  air¬ 
craft. 

CMC  provides  effective  analysis  of  com¬ 
bat  issues  by  employing  state-of-the- 
art  models  (TSAR,  TSARINA,  DYNA-Metric 
or  actual  spares  resources)  to  evaluate 
the  capabilities  of  Air  Force  units  to 
support  combat  operations.  Results  are 
integrated  for  complete  modeling  por¬ 
trayal  of  base  activities.  Dynamic 
conditions  such  as  early  combat  surge 
periods  and  sustained  operations  can 
be  portrayed.  The  methodology  inte¬ 
grates  the  combat  effects  of  airbase 
attacks  (e.g.,  runway  damage,  facili¬ 
ties  damage,  resource  losses),  post¬ 
attack  delay  impacts,  aircraft  attri¬ 
tion,  and  aircraft  battle  damage.  This 
provides  simultaneous  interaction  of 
combat  effects  with  base  activities. 
CMC  results  in  realistic  representa¬ 
tions  for  projecting  base  combat  main¬ 
tenance  capability. 

This  technology  development  effort  has 
been  completed.  CMC  assessment  via 
computer  simulation  modeling  has  been 
successfully  demonstrated  with  the 
F-16  aircraft  at  Hahn  AB,  Germany  and 
F-lllF  aircraft  at  RAF  Lakenheath,  UK. 


review  prior  to  printing.  The  techni¬ 
cal  report  for  the  F-111F  phase  of  the 
project  is  in  the  initial  draft  stage. 


Combat  Maintenance  Capability 


This  R&D  effort  has  been  successful  in 
developing  a  capability  assessment 
methodology  that  considers  the  syner¬ 
gistic  effects  of:  maintenance  and 
support  activities,  operational  task- 
ings,  availability  of  support  assets, 
enemy  airbase  attacks,  mission  aircraft 
attrition  and  alternative  conditions. 
An  Executive  Summary,  AFHRL-TR-85-35, 
is  in  distribution.  Technical  reports, 
"Findings  and  Computer  Simulation  Re¬ 
sults"  and  "Methodology,"  are  in  final 


Simulation  of  48th  TFW  combat  mainte¬ 
nance  has  been  successfully  demonstrat¬ 
ed  at  RAF  Lakenheath,  UK.  Combat  main¬ 
tenance  has  been  assessed  and  limiting 
factors  identified  for  scenario  condi¬ 
tions  and  the  CMC  methodology  refined. 
A  follow-on  advanced  development  effort 
is  planned  to  further  refine  and  test 
the  methodology  and  to  demonstrate  its 
use  in  conjunction  with  other  advanced 
technologies  to  improve  combat  opera¬ 
tions  capability. 

Contact:  Mr.  Richard  E.  Weimer 
AFHRL/LRC 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-2606 
AUTOVON  785-2606 


Small  Unit  Maintenance  Manpower 
Ana lyses (SUMMAT 

The  current  and  future  emphasis  on  com¬ 
bat  mobility,  flexibility,  and  sustain¬ 
ability  of  our  Tactical  Air  Forces 
causes  us  to  redefine  the  scope  and 
content  of  maintenance  occupations. 
The  prospects  of  airbase  dispersal  and 
small  unit  operations  during  periods 
of  conflict  imply  broadened  task  train¬ 
ing  for  the  maintenance  workforce  as  a 
key  element  of  logistics  support.  The 
SUMMA  program  is  developing  technology 
that  can  provide  a  computer-based  de¬ 
cision  support  system  useful  for: 

projecting  and  analyzing  combat 
workloads  based  on  deployment 
scenarios , 

allocating  maintenance  tasks  to 
new  or  redefined  job  specialties, 

evaluating,  through  integration  of 
logistics  performance  simulation 
and  force  management /policy  analy¬ 
sis,  the  combat  effectiveness  and 
feasibility  of  desired  job  restruc¬ 
tures. 


The  SUMMA  decision  support  system  is 
being  developed  using  the  F-16  for  con¬ 
cept  prototype  application.  Key  devel¬ 
opments  during  FY86  were  the  mathemat¬ 
ical  formulation  of  a  task  allocation 
optimization  algorithm  and  the  creation 
of  large  F-16  task  analysis  and  sup¬ 
porting  personnel  and  training  data¬ 
bases.  The  data  on  task  learning,  task 
performance,  and  task  time  are  key  in¬ 
puts  to  the  task  allocation  and  reallo¬ 
cation  problem. 

Key  remaining  efforts  are  the  integra¬ 
tion  of  methods  and  databases  and  their 
translation  into  a  microcomputer-based 
software  package  that  will  function  as 
a  workstation. 

When  fully  developed,  the  SUMMA  deci¬ 
sion  support  system  can  be  used  by 
analysts  working  in  System  Program 
Offices  to  help  in  the  definition  and 
redefinition  of  maintenance  occupations 
for  new  weapon  systems.  For  managers 
in  the  manpower,  personnel,  and  train¬ 
ing  arenas,  SUMMA  will  allow  a  fuller 
analysis  of  proposed  changes  in  occu¬ 
pational  structure  and  the  capability 
to  judge  the  probable  contribution  of 
restructured  maintenance  specialties 
to  success  in  the  combat  environment. 

Contact:  Mr.  Edward  S.  Boyle 

AFHRL/LRC 

Wright-Patterson  AFB,  OH  45433 

Commercial  (513)  255-2606 

AUTOVON  785-2606 


Logistics  Systems  Branch  (LRL) 

The  objectives  of  this  Branch  are  to 
develop  capabilities  (a)  to  analyze  Air 
Force-wide  logistics  concepts  and  re¬ 
quirements  in  terms  of  their  impact  on 
our  ability  to  conduct  combat  opera¬ 
tions  and  (b)  to  augment  decision¬ 
making  processes  within  the  logistics 
support  structure. 


in  the  FUTURE  LOOK  85  Logistics  Long 
Range  Planning  Guide,  FY  1988-2002  pub¬ 
lished  by  HQ  USAF/DCS  for  Logistics. 

Specifically,  our  R&D  is  directed  to¬ 
ward  incorporating  advanced  technolo¬ 
gies  and  methodologies  to  meet  war¬ 
fighting  capabilities  by  providing  the 
too  1 8  needed  (a)  to  compare  and  eval¬ 
uate  deployment /employment  and  support 
concepts  of  operations  and  predict  war¬ 
time  resource  requirements  and  (b)  to 
enhance  the  capabilities  of  decision 
makers  within  the  support  structure. 

The  program  is  an  amalgam  of  explora¬ 
tory  research  and  advanced  development 
efforts  which  will  culminate  in  two 
significant  contributions  for  the  USAF. 
The  first  encompasses  model  and  algo¬ 
rithm  developments.  These  will  provide 
the  capabilities  to  evaluate  logistics 
supportability  in  situations  requiring 
responses  to  anticipated  but  difficult- 
to-quantify  events.  The  second  is  a 
series  of  generic  models  of  decision 
and  information  flow  processes.  These 
will  provide  improved  automation  aids 
for  support  personnel  within  the  logis¬ 
tics  infrastructure. 

A  basic  problem  exists  in  most  models 
currently  employed  for  capability  as¬ 
sessment.  Operations  assessment  models 
tend  to  aggregate  (sometimes  ignore) 
logistics  and  maintenance  aspects  and 
impacts.  At  the  same  time,  logistics 
support  assessment  models  tend  toward 
minimal  operational  input.  A  need 
exists  to  provide  simulation  capabili¬ 
ties  that  will  overcome  these  and 
other  modeling  shortfalls.  Specific 
benefits  will  include:  (a)  integration 
of  both  current  and  proposed  deploy¬ 
ment/employment  and  support  concepts 
of  operations,  (b)  better  quantifica¬ 
tion  of  the  interactions  among  these 
concepts,  and  (c)  more  accurate  pre¬ 
dictions  of  theater-level  resource 
requirements  for  consumables,  spare 


parts,  support  equipment,  and  personnel 
AFHRL/LRL  is  conducting  R&D  to  address  to  meet  the  demands  of  combat  flying 
certain  priority  objectives  outlined  schedules. 


With  the  onslaught  of  more  and  more 
automated  systems  and  databases,  per¬ 
sonnel  involved  with  the  identification 
of  logistics  support  requirements  need 
decision  support  technology  to  perform 
their  functions  effectively  and  effi¬ 
ciently.  The  ever-increasing  workload 
and  information  availability  at  all 
levels  impact  requirements  for  proper 
and  accurate  decision  making  within  the 
support  structure.  A  need  exists  to 
provide  decision  support  systems  to  al¬ 
leviate  this  workload  for  both  experi¬ 
enced  and  new  personnel  within  the  sys¬ 
tem.  Specific  benefits  will  include: 
(a)  accurate  representations  of  docu¬ 
mented  and  "gut  feel"  decision-making 
rules,  (b)  timely  forecasts  for  pro¬ 
curement  actions,  (c)  improved  readi¬ 
ness  by  reducing  reprocurement  lead- 
time,  (d)  reduction  in  pipeline  choke 
points,  and  (e)  improved  surge-handling 
capabilities  to  meet  combat  require¬ 
ments. 

To  satisfy  these  needs,  a  complex  R&D 
and  transition  program  has  been  imple¬ 
mented.  This  program  involves  internal 
efforts  as  well  as  cooperative  work 
with  other  Branches,  Divisions,  Labora¬ 
tories,  and  Major  Commands.  Much  ini¬ 
tial  groundwork  has  already  been  cover¬ 
ed,  with  past  and  ongoing  work  related 
to  database  construction  for  demand 
rate  estimation,  application  of  exist¬ 
ing  logistics  assessment  models,  and 
initial  concept  analysis  methodology. 
Future  efforts  will  evaluate  and  ad¬ 
dress  the  critical  interfaces  among  de¬ 
velopment,  logistics,  and  operations 
systems.  These  will  culminate  in  tools 
essential  to  increase  readiness  through 
comparisons  of  alternative  concepts  and 
through  provisions  for  decision  support 
systems.  This  program  has  been  devised 
to  provide  the  USAF  new  capabilities 
in  two  major  areas  of  need: 

(1)  Exploration  and  advanced  R&D 
efforts  are  already  underway  in  the 
areas  of  predicting  wartime  resource 
requirements,  developing  combat  data, 
and  developing  support  concept  analysis 


methodology.  Work  performed  under  the 
first  area  is  exploratory  in  prepara¬ 
tion  for  an  expanded  advanced  develop¬ 
ment  effort.  In  fact,  the  advanced 
effort  has  already  begun  with  the  col¬ 
lection  of  existing,  available  histor¬ 
ical  combat  data  in  preparation  for  the 
development  of  systematic  methods  to 
forecast  wartime  resource  requirements. 
Further  efforts  center  on  exploratory 
research  related  to  specific  aircraft 
subsystems  for  inclusion  in  advanced 
R&D  to  better  define  the  overall  meth¬ 
odology.  The  tools,  databases,  and 
models  resulting  from  this  process 
will,  in  turn,  be  fundamental  to  on¬ 
going  and  future  advanced  R&D.  Current 
efforts  focus  on  a  methodology  includ¬ 
ing  an  executive  program  which  controls 
a  series  of  existing  computer  models 
to  analyze  resource  requirements  by 
passing  information  among  existing  lo¬ 
gistics  assessment  models.  We  are  now 
beginning  to  explore  the  integration 
of  operations,  logistics,  and  other 
combat  assessment  models  to  the  end 
that  an  integrated  system  concept  meth¬ 
odology  will  be  conceived.  Advanced 
R&D  in  this  area  will  result  in  a  tool 
capable  not  only  of  realistically  esti¬ 
mating  resource  requirements,  but  also 
of  depicting  the  interactions  between 
the  employment/deployment  and  logistics 
concepts  of  operations. 

(2)  The  second  series  of  develop¬ 
ments  involves  systematic  R&D  into  the 
evolution  of  logistics  decision  support 
systems.  This  involves  a  three-pronged 
effort  to  provide  new  capabilities  to 
personnel  involved  with,  and  working 
within,  the  logistics  support  struc¬ 
ture.  Decision  support  systems  will 
be  devised,  following  a  thorough  sys¬ 
tems  analysis,  for  use  at  various  lev¬ 
els  within  the  logistics  infrastruc¬ 
ture.  These  systems  will  be  tailored 
to  their  intended  environment,  but  will 
also  be  generic  in  nature  to  allow  fur¬ 
ther  expansion  and  enhancement.  The 
intent  is  to  conduct  the  R&D  that  will 
ensure  overall  system  interoperability 
and  compatibility. 


Cunship 

Gunship  Project 

Key  decisions  affecting  the  life-cycle 
cos  t  of  a  weapon  system  program  are 
made  before  full-scale  engineering  de¬ 
velopment  begins.  The  Air  Force  cur¬ 
rently  lacks  adequate  methodology  to 
analyze  supportability  issues  during 
the  conceptual  design  phase.  At  the 
request  of  the  Aeronautical  Systems 
Division  (ASD),  AFHRL/LR  developed  and 
demonstrated  techniques  for  analysis 
of  the  human  factors,  training,  and  lo¬ 
gistics  drivers  for  future  gunship  de¬ 
sign  and  employment  concepts. 

The  ability  to  conduct  quantitative 
analysis  of  supportability  issues  in 
the  conceptual  design  phase  will  reduce 
weapon  system  life-cycle  costs  and  in¬ 
crease  supportability,  thus  improving 
overall  war-fighting  capability. 

This  effort  was  a  baseline  support- 
ability  analysis  of  a  representative, 
state-of-the-art  technology,  near-term, 
replacement  gunship.  Emphasis  ./as  on 
quantification  of  selected  resources 
for  a  specific  weapon  system  design, 
and  developed  missions  and  scenarios. 
The  intent  was  to  provide  a  baseline 
comparison  system  and  accumulate  pre¬ 
liminary  data  for  a  replacement 


gunship.  A  two-pronged  approach  was 
taken.  A  contractor-performed  effort 
used  analytical  techniques  to  quantify 
selected  logistics  requirements.  An 
in-house  effort  was  also  performed 
using  computer  simulation  techniques 
to  assess  sortie  generation  capability 
and  maintenance  manpower  requirements. 

Both  efforts  are  complete  and  in  the 
process  of  being  documented.  Their  ap¬ 
plication  to  both  the  Replacement 
Gunship  Program  and  Gunship  III  have 
been  recognized  by  ASD,  who  has  re¬ 
quested  the  results  be  briefed  to  both 
the  Air  Staff  and  MAC  Headquarters. 
Results  have  also  been  presented  to 
the  Air  Force  Logistics  Command  (AFLC) 
and  the  Acquisition  Logistics  Analysts 
Conference. 

Contact:  Capt  Thomas  J.  King 
AFHRL/LRL 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-8418 
AUTOVON  785-8418 


Mission  Reliability  Model  (MIREM) 

MIREM  was  developed  to  evaluate  the  re¬ 
liability  and  fault  tolerance  of  new 
integrated  avionics  systems  and  to 
identify  potential  design  changes  to 
improve  reliability  during  the  concep¬ 
tual  stages  of  design.  Traditional 
models  and  methods  could  not  evalu¬ 
ate  reconfigurable  systems.  As  a  new 
front-end  analysis  technique,  MIREM 
gives  the  design  engineer  and  logistics 
manager  the  capability  to  do  interac¬ 
tive  data  entry,  to  moderate  data  re¬ 
quirements,  and  to  perform  sensitivity 
analyses.  The  model  will  be  transi¬ 
tioned  to  Rome  Air  Development  Center 
(RADC)  for  inclusion  in  a  Military 
Standard  and  for  application  to  a  vari¬ 
ety  of  reliability  prediction  problems. 

Since  MIREM  is  Air  Force-owned  soft¬ 
ware,  our  approach  has  been  to  give  the 
model  the  widest  possible  exposure.  In 
order  to  ensure  its  accuracy,  an  effort 
is  underway  to  verify  the  algorithms 
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used  in  MIREM.  Several  enhancements 
have  been  added  that  expand  the  model's 
scope  to  a  broad  class  of  fault  toler¬ 
ant  reliability  problems. 

During  FY86,  several  briefings,  includ¬ 
ing  a  technical  seminar,  were  given  to 
R&D  personnel  of  other  Air  Force  lab¬ 
oratories.  The  model  was  well  received 
and  is  now  being  used  on  the  Ultra-Re¬ 
liable  Radar  (URR)  program  at  the  Air 
Force  Wright  Aeronautical  Laboratories 
(AFWAL)  Avionics  Laboratory.  Verifica¬ 
tion  of  the  original  release  of  MIREM 
(October  1984)  has  been  completed.  New 
features  recently  added  include:  quan¬ 
tifying  the  effects  of  imperfect  test¬ 
ability;  innovative  repair  policies; 
and  graphics.  MIREM  now  has  the  capa¬ 
bility  to  model  cascaded  circuits  that 
use  more  than  two  levels  of  redundancy. 

The  improved  version  of  MIREM  was  re¬ 
leased  in  March  1986.  Draft  user  and 
programmer  guides  have  also  been  pre¬ 
pared  and  will  be  published  shortly. 

With  the  assistance  of  RADC,  the  newest 
version  of  MIREM  will  be  verified  in 
the  coming  year.  The  model  will  also 
be  transitioned  to  RADC  in  order  to 
provide  a  permanent  home  for  the  soft¬ 
ware.  As  the  MIREM  technology  nears 
maturity,  our  plan  is  to  pave  the  way 
for  its  widest  possible  use  by  the  Air 
Force  R&D  community.  One  MIREM  appli¬ 
cation  has  been  in  support  of  the 
Strategic  Defense  Initiative  Office. 
MIREM  was  identified  as  a  technique  to 
assess  the  ability  of  various  battle 
management  nodes  to  function  under  se¬ 
lected  scenarios.  This  application 
shows  the  potential  of  MIREM  to  serve 
as  an  analysis  tool  beyond  modular 
avionics. 


Contact:  1st  Lt  Lee  H.  Dayton 
AFHRL/LRL 

Wr ight-Patterson  AFB,  OH  45433 
Commercial  (513)  255-8418 
AUTOVON  785-8418 


Unified  Life  Cycle  Engineering  (ULCE) 

One  of  the  major  information  and  deci¬ 
sion  science  technology  development  re¬ 
quirements  identified  during  the  recent 
Project  Forecast  II  study  was  the  need 
to  integrate  "design  for  produc ibility" 
and  "design  for  supportability"  into 
the  weapon  system  design  process  along 
with  "design  for  performance,  cost,  and 
schedule."  Consideration  of  these 
"ilities"  ( producibility ,  maintainabil¬ 
ity,  reliability,  sustainability,  etc.) 
during  the  conceptual  design  phase  will 
reduce  weapon  system  life-cycle  costs 
and  increase  supportability,  thus  im¬ 
proving  overall  war-fighting  capabil¬ 
ity.  This  requirement  was  identified 
based  on  the  study  team's  judgment  that 
current  manual  system  design  and  infor¬ 
mation  management  techniques  for  making 
complex  decisions  involving  trade-offs 
among  competing  design  requirements  are 
inadequate.  The  Forecast  II  team  felt 
that  the  advances  being  made  in  Comput¬ 
er-Aided  Design  (CAD),  Computer-Aided 
Manufacturing  (CAM),  and  Computer-Aided 
Engineering  (CAE),  along  with  advances 
being  made  in  integrated  networked  de¬ 
sign  information  systems,  held  the 
promise  of  allowing  truly  integrated 
engineering  design  development  for  fu¬ 
ture  weapon  systems.  The  overall  ob¬ 
jective  of  this  multiple-agency  program 
is  to  develop,  demonstrate,  and  trans¬ 
fer  to  application,  by  1995,  the  tech¬ 
nologies  needed  to  provide  integration 
of  "design  for  producibility"  and  "de¬ 
sign  for  supportability"  with  "design 
for  performance,  cost,  and  schedule." 

This  program  is  being  conducted  by  a 
number  of  Air  Force  agencies.  These 
include  AFHRL,  the  AFWAL  Materials  and 
Flight  Dynamics  Laboratories  of  the 
ASD,  and  RADC.  The  long-term  program 
plan  for  ULCE  is  to  provide  an  informa¬ 
tion/decision  support  technology  base 
for  the  next-generation  design  system. 
As  conceived,  this  contemplated  new  ca¬ 
pability  will  allow,  through  an  inte¬ 
grated  automated  information  management 


system,  "cradle  to  grave"  program  man¬ 
agement.  This  in  turn  will  signifi¬ 
cantly  reduce  design-to-manufacture 
lead-times  and  prototyping  require¬ 
ments,  and  significantly  improve  sup- 
portability.  Near-term  technology 
development /demonstration  efforts  will 
focus  on  the  development  of  design 
tools/models  in  the  Reliability, 
Availability,  and  Maintainability  in 
Computer-Aided  Design  (RAMCAD)  domain. 
The  objective  of  this  work  is  to  better 
define  and  understand  the  interaction 
between  these  RAMCAD  tools/models  and 
CAD/CAM  tools/models  and  to  integrate 
them  into  a  decision  support  system 
embedded  in  the  design  environment. 

Several  ongoing  AFHRL/LR  technology  de¬ 
velopment  programs  will  form  the  tech¬ 
nology  core  needed  to  integrate  sup- 
portability  into  the  CAD  process.  CREW 
CHIEF  is  representative  of  the  type  of 
supportability  model  that  can  be  incor¬ 
porated  within  the  ULCE  concept.  RAM¬ 
CAD  has  formed  a  university/industry 
consortium  to  coordinate  R&D  and  speed 
the  transition  of  R&D  products.  The 
Integrated  Design  Support  (IDS)  system 
will  provide  the  basic  technology  for 
developing  an  architecture  and  informa¬ 
tion  management  system  capable  of  inte¬ 
grating  the  required  models  and  data¬ 
bases  in  real  time. 

A  new  FY87  project  will  develop  a  deci¬ 
sion  support  system  to  aid  the  design 
engineer  during  the  trade-off  process 
among  competing  design  requirements. 
For  example,  the  reliability  of  a  part¬ 
icular  part  must  be  compared  to  its 
cost,  weight,  size,  and  many  other  mea¬ 
sures  to  obtain  an  "optimum"  design. 
To  determine  impacts  on  system  reli¬ 
ability,  the  reliability  of  that  part 
must  also  be  compared  to  the  reliabil¬ 
ity  of  the  other  parts  with  which  it 
interacts. 


technical  plan  by  the  first  quarter  of 
FY87.  In-house  and  contract  work  is 
expected  to  begin  by  January  1987. 

Contact:  Capt  Thomas  J.  King 
AFHRL/LRL 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-8418 
AUTOVON  785-8418 


Ground  Operations  Branch  (LRG) 

The  objective  of  this  branch  is  to  im¬ 
prove  the  combat  readiness  of  bat¬ 
tle  managers  (individuals)  and  battle 
staffs  (teams)  assigned  to  both  cen¬ 
tralized  and  functionally  distributed 
Command  and  Control  (C^)  systems 
through  research,  development,  test, 
and  application  of  advanced  training 
and  human  performance  technology.  The 
primary  R&D  objectives  of  this  program 
are  taken  from  the  Tactical'  Air  Force 
Interoperability  (TAFIS)  Master  Plan, 
the  21st  Century  TAC  and  Control  System 
Studies  (CSS),  Tactical  Air  Control 
System  2000  (TACS),  recommendations  of 
the  Defense  Sciences  Board,  and  DOD/AF/ 
TAF  planning  documents.  The  intent  is 
to  develop  better  ways  to  organize  and 
train  battle  staffs  and  battle  managers 
for  wartime  C^  operations;  assess  the 
value  of  these  preparations;  provide 
human  performance  design  input  during 
the  acquisition  cycle  for  new  C^  sys¬ 
tems;  and  develop  methods,  specifica¬ 
tions,  and  field  demonstrations  of  how 
to  practice  and  sustain  this  combat 
readiness  during  peacetime.  The  ap¬ 
proach  focuses  on  the  human  elements 
of  C^  systems  but  considers  all  other 
system  elements  in  the  approaches 
followed. 

Work  being  accomplished  or  planned  is 
directed  toward  three  major  goals.  All 
require  better  understanding  of  the 


The  ULCE  program  is  now  being  planned.  human  and  system  information  and 
A  Draft  Implementation  Plan  was  comple-  decision  processes.  The  first  goal  is 
ted  in  June  1986.  A  working  group  has  to  develop  technology  to  improve 
been  formed  to  complete  a  detailed  combat  readiness  training  of  the 


individuals  and  teams  assigned  to  the 
operational  and  logistics  elements  of 
the  theater  and  force  management  levels 
(Tactical  Air  Forces  [TAF]  and  Tactical 
Air  Control  Center  [TACC]).  The  second 
is  to  develop  practical  performance 
assessment  methods  for  these  functions. 
The  third  is  to  develop  human  perform¬ 
ance  design  guidance  for  application  by 
the  design  (RADC)  and  acquisition  (ESD) 
communities  to  allow  procurement  of 
systems  that  fully  consider  the  human 
operators.  Past  efforts  in  this  area 
have  focused  on  the  TAF/TACC  levels.  In 
the  future,  we  will  place  more  emphasis 
on  the  generalization  of  this  tech¬ 
nology  toward  additional  applications 
in  missile  and  space  systems,  with 
particular  emphasis  on  support  for 
future  space  C^  issues. 

The  number  of  variables  that  can  poten¬ 
tially  impact  the  operational  readiness 
of  battle  staffs  and  battle  managers 
assigned  to  (or  scheduled  to  be  assign¬ 
ed  to)  tactical  C^  systems  is  very 
large.  Efforts  focus  on  specific  as¬ 
pects  of  combat  job  requirements  analy¬ 
sis,  system/human  interaction  modeling, 
advanced  training  technology,  training/ 
exercising  devices  and  methods,  devel¬ 
opment  of  internal  and  external  assess¬ 
ment  methods,  and  human  performance 
studies  relevant  to  system  operation. 
These  have  been  prioritized  based  on 
the  state  of  technology  development, 
user  requirements,  resource  con¬ 
straints,  and  predicted  payoff. 

Technology  development  and  application 
programs  in  this  Branch  support  broad 
areas  of  R&D  on  training  and 
operations.  Work  is  conducted  with/in 
support  of  USAFE,  RADC,  TAC,  AAMRL, 
the  Tactical  Air  Warfare  Center  (TAWC), 
the  Electronic  Systems  Division  (ESD), 
the  9th  AF,  and  other  DOD  agencies. 
Planning  activities  are  underway  to 
provide  technology  development  and 
application  support  to  Space  Command, 
the  Strategic  Defense  Initiative 
Office,  and  the  Strategic  Air  Command. 


Work  initiated  several  years  ago  to 
develop  a  task  analysis  database 
technology,  to  support  users  such  as 
Blue  Flag,  continues.  A  program  to 
train  American  logistics  controllers 
on  NATO  procedures  was  delivered  to 
USAFE.  Another  Branch  program  investi¬ 
gates  decision  making  in  a  simulated 
Combat  Plans  Division  of  a  TACC.  The 
purpose  of  this  R&D  is  to  better  under¬ 
stand  the  decision-making  processes 
used  in  preparing  Air  Tasking  Orders 
(ATOs). 

The  Visual  Simulation  for  Tactical  Com¬ 
mand  and  Control  System  (VISTACS)  pro¬ 
gram  will  provide  photogrammetric-based 
computer  image  generation  for  training 
on  mission  planning  and  related  activi¬ 
ties.  Several  additional  studies  are 
being  planned  to  investigate  the  re¬ 
quired  level  of  imagery  realism,  among 
other  variables.  Fundamental  R&D  in 
the  areas  of  human  automaticity  and 
multiple  resource  variables  is  also 
underway. 


Visual  Simulation  Equipment 
for  C^  Research 
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Other  work,  to  be  initiated  in  FY87, 
will  determine  whether  artificial 
intelligence  techniques  can  be  adapted 
to  map  the  knowledge  base  of  C2  ex¬ 
pert  decision  makers.  Results  of  this 
work  should  provide  technologies  to 
improve  the  training  of  TACC  battle 
staffs.  Also  in  FY87,  efforts  to 
investigate  the  performance  effects  of 
various  levels  of  automation  within 
tactical  C2  systems  will  begin.  Sim¬ 
ulation  modeling  tools  using  artificial 
intelligence  techniques  will  be  devel¬ 
oped  to  allow  C2  system  designers  to 
predict  the  effects  on  overall  system 
functions  (e.g.,  tasks,  skills,  train¬ 
ing)  resulting  from  the  introduction 
of  automation. 

Command  and  Control  R&D  Capability 
Enhancements 

US  Air  Force  C2  battle  managers  and 
their  supporting  staffs  are  faced  with 
increasing  amounts  of  information  to 
review  while  having  less  time  in  which 
to  make  critical  decisions.  Many  of 
the  projected  combat  scenarios,  coupled 
with  the  capabilities  of  current  and 
planned  operations,  intelligence,  and 
communications  support  systems,  allow 
only  a  brief  period  of  time  in  which  a 
correct  decision  must  be  made  to 
achieve  a  combat  objective.  As  an  ad¬ 
ditional  complicating  factor,  many  of 
the  future  C2  systems  will  allow 
functionally  distributed  and  physically 
dispersed  operation  of  C2  nodes  to 
increase  their  survivability.  If  cer¬ 
tain  nodes  of  a  C2  system  become  non- 
operational,  other  nodes  will  have  to 
assume  some  functions  previously  allo¬ 
cated  elsewhere.  Accordingly,  the  com¬ 
plexity  of  battle  management  will  grow. 
With  this  growth  comes  an  increasing 


tial  to  increasing  the  probability  of 
successful  combat  performance.  In  or¬ 
der  to  achieve  this  objective,  we  must 
have  a  better  understanding  of  the  com¬ 
bat  decision  maker's  mental  model 
(i.e.,  his  information  processing 
strategies,  decision  approaches,  etc.) 
of  the  situation(s)  and  the  associated 
decision  processes.  Because  little  R&D 
on  decision  making  has  been  aimed  at 
complex,  nonproceduralized ,  time-criti¬ 
cal,  and  often  stressful  situations, 
not  much  is  known  about  the  battle  man¬ 
ager's  mental  model.  The  payoff  of 
this  work  will  be  not  only  more  realis¬ 
tic  combat  preparation  for  the  opera¬ 
tional  forces  but  also  design  informa¬ 
tion  on  human  performance  capabilities 
relevant  to  new  system  technology  de¬ 
velopment  and  acquisition  agencies 
(e.g.,  RADC  and  ESD). 

During  1985-86,  work  was  initiated  to 
upgrade  the  current  AFHRL/LRG  In- 
House  Team  Performance  R&D  Facility  to 
a  secure  operating  environment.  De¬ 
tailed  plans  were  prepared  to  design  a 
facility  with  adaptable  and  recon- 
figurable  workstations  to  enable 
several  nodes  of  a  given  C2  system 
to  be  simultaneously  emulated.  This 
adaptability  will  allow  the  facility 
to  support  in-house  and  contractually 
supported  R&D  on  a  variety  of  systems 
and  programs  (e.g.,  tactical  and 
strategic  C2,  space  ground  control, 
Strategic  Defense  Initiative).  In  ad¬ 
dition  to  the  computer  hardware  re¬ 
quirements  and  physical  layout,  consid¬ 
erable  work  was  done  to  identify  exist¬ 
ing  simulation  software  to  support 
needed  simulations  to  use  as  baselines 
for  expanding  and  testing  new  combat 
training  exercise  programs.  Also,  the 
feasibility  of  providing  a  satellite 
and/or  ground  link  to  other  facilities, 


requirement  to  provide  realistic  combat 
training  opportunities  to  prepare  our 
C2  battle  managers,  their  staffs,  and 
supporting  agencies. 

Providing  Air  Force  C2  battle  man¬ 
agers/staffs  with  advanced  training 
technology  to  allow  realistic  learning 
and  practice  of  combat  tasks  is  essen- 


such  as  the  RADC  Battle  Management  Re¬ 
search  Facility,  AAMRL  Operator 
Performance  Engineering  Facility,  and 
the  AFHRL  Operations  Training  Divi¬ 
sion,  is  being  investigated  as  part  of 
a  contemplated  networking  to  allow 
joint  studies  of  distributed  C2  de¬ 
cision  making. 


The  basic  physical  facility  modifica¬ 
tions  have  been  completed  and  the  plan 
to  achieve  this  significant  R&D  capa¬ 
bility  enhancement  was  completed  in 
September  1986.  Current  hardware  con¬ 
figuration  includes  DEC  VAX  systems, 
symbolic  processors,  graphic  systems, 
and  various  user  terminals  and  worksta¬ 
tions.  Additional  renovations  are 
planned  in  FY87  in  order  to  complete 
the  facility.  Some  hardware,  such  as 
LISP  machines,  was  purchased,  and  the 
design  of  the  facility  was  initiated. 
It  is  anticipated  that  R&D  to  support 
a  variety  of  users  will  be  conducted 
in  1987  while  facility  renovation  is 
underway. 

Contact:  Dr.  Lawrence  E.  Reed 
AFHRL/LRG 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-8607 
AUTOVON  785-8607 


Computerized  Training  and  Design  Tools 
for  Tactical  Command  and  Control 

Traditional  task  analysis  techniques 
are  not  well  suited  for  describing 
activities  in  a  complex  C2  system 
such  as  TACS.  These  techniques  rely  on 
the  ability  of  an  observer  to  capture 
the  process  under  scrutiny  by  observing 
and  recording  the  active  system  in  a 
structured  manner.  The  geographical 
dispersion,  individual  decision  making, 
and  frequent  small  group  interactions 
characteristic  of  a  TACC  make  observa¬ 
tions  difficult.  A  second  problem  is 
that  detailed  and  current  data  on  ac¬ 
tual  TACS  organizational  structure  and 
assignment  of  functions  to  individual 
organizations  often  do  not  exist.  Data 
which  do  exist  are  outdated  and/or  do 
not  provide  the  required  level  of  de¬ 
tail.  This  constrains  the  design  proc¬ 
ess  for  new  tactical  C2  systems. 
Whenever  a  new  system  is  being  designed 
or  retrofit  of  a  new  capability  to  an 
existing  system  is  contemplated,  data 
must  first  be  collected  on  current  sys¬ 
tems  and  configurations,  thus  slowing 
the  design  process.  A  third  problem  is 


the  need  for  highly  trained  analysts 
working  one-on-one  with  C2  personnel 
to  collect  data  at  the  job  site.  This 
type  of  data  collection  is  difficult 
due  to  the  widely  dispersed  CONUS  and 
overseas  locations,  the  requirement  not 
to  interfere  with  job  duties,  and  the 
extensive  time  required. 

To  address  these  problems,  an  in-house 
program  is  underway  to  design  and  de¬ 
velop  a  computerized  task  analysis  sys¬ 
tem  that  will  allow  operational  person¬ 
nel  to  input  task  analysis  data  them¬ 
selves,  at  their  job  site,  whenever 
they  have  spare  time.  The  contemplated 
data  collection  system  will  then  per¬ 
form  an  analysis  of  the  data  to  gener¬ 
ate  both  a  database  which  contains  a 
model  of  the  system  (to  the  positional 
level)  and  an  error  report  which  lists 
inconsistent  and  missing  data.  This 
system  will  provide  the  Air  Force  with 
a  capability  to  collect  accurate  data 
from  C2  system  operators  in  a  more 
expedient  and  less  costly  manner.  Ad¬ 
ditionally,  the  database  generated  will 
provide  the  design  community  with  ac¬ 
curate  and  detailed  knowledge  about 
C  functional  nodes  and  operations 
prior  to  the  start  of  a  design  effort. 
Software  is  being  developed  to  automate 
task  analysis  data  collection  from 
Subject-Matter  Experts  (SME).  This 
software,  which  runs  on  standard  Air 
Force  microcomputers,  guides  the  SMEs 
through  a  data  collection  session  by 
asking  questions  and  recording  respons¬ 
es.  The  data  files  generated  are  then 
analyzed  by  a  second  program,  which 
builds  a  model  of  the  system  under 
evaluation  and  generates  an  error  re¬ 
port.  The  model  of  the  system  is  then 
loaded  into  a  relational  database.  The 
error  report  generated  allows  the  an¬ 
alyst  to  address  the  problems  encount¬ 
ered.  After  in-house  testing,  field 
tests  will  be  conducted  to  assess  the 
system  and  if  validated,  the  software 
will  be  made  available  to  relevant  DOD 
agencies  for  their  use.  AFHRL/LRG  will 
use  the  data  collected  to  build  a  data 
library.  These  new  data  may  then  be 
merged  with  already  existing  data  on 


other  systems  to  provide  the  com¬ 
munity  with  a  current  database  with 
multiple  applications. 

Software  that  will  allow  SMEs  to  input 
data  was  developed  and  debugged  during 
FY86.  In  FY87,  software  to  analyze  the 
collected  data  will  be  developed  and 
debugged.  A  field  test  of  the  proto¬ 
type  system  is  planned  during  the  last 
quarter  of  FY87. 

Contact:  Mr.  Michael  J.  Young 
AFHRL/LRG 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-8229 
AUTOVON  785-8229 


Acquisition  Logistics  Branch  (LRA) 

The  objective  of  the  Branch  is  to  pro¬ 
vide  the  technological  components  of 
structured  engineering  information  sup¬ 
port  and  automated  management  processes 
for  acquiring  more  supportable  and  sus¬ 
tainable  systems.  Key  programs  address 
the  exploitation  of  computer  technology 
for  designed-in  supportability  and  the 
integration  of  automated  technical  in¬ 
formation. 

The  future  predicted  by  Air  Force  2000 
requires  more  dispersed  and  mobile  op¬ 
erations  that  can  be  achieved  only  if 
the  new  weapon  systems  are  designed  for 
increased  availability,  supportability, 
and  sustainability.  Similarly,  the 
Strategic  Defense  Initiative  will  re¬ 
quire  very  high  levels  of  reliability 
at  much  lower  cost.  DOD  Directive 
5000.39,  the  Acquisition  Improvement 
Program,  the  Air  Force  Reliability  and 
Maintainability  (R&M)  2000  Program,  and 
AF  2000  call  for  increasing  readiness 
through  R&D  and  policy  changes.  At  the 
same  time,  the  prospect  of  limited  bud¬ 
gets  and  increasing  Soviet  weapon  sys¬ 
tem  sophistication  requires  that  we 
develop  more  supportable  systems  faster 
and  at  substantially  lower  cost.  The 
need  to  employ  computer  technology  to 
develop  more  supportable  weapon  systems 
faster  and  cheaper  has  been  identified 


more  recently  by  the  Office  of  the  Sec¬ 
retary  of  Defense  (OSD)  and  the  Insti¬ 
tute  for  Defense  Analysis  (IDA)  through 
two  joint  studies.  The  R&M  study  and 
the  Computer-Aided  Logistics  Support 
(CALS)  Study  structured  policy  initia¬ 
tives  which  were  affirmed  in  a  1985 
Memorandum  by  Deputy  Secretary  of  De¬ 
fense  William  H.  Taft  IV.  This  Memor¬ 
andum  requires  the  Services  to  imple¬ 
ment  CALS  concepts  by  the  year  1990. 
AFHRL/LRA  is  the  primary  Air  Force  R&D 
agency  responsible  for  developing  the 
automation  and  system  integration  tech¬ 
nology  to  enable  CALS. 

The  acquisition  logistics  R&D  program 
will  aid  in  overcoming  technical  defi¬ 
ciencies  and  hence,  achieve  the  Air 
Force  objective  of  improved  support- 
ability  and  sustainability.  This  R&D 
program  forms  a  nucleus  for  the  Air 
Force  response  to  the  CALS  initiative 
and  also  provides  a  strategy  to  resolve 
technical  deficiencies.  Each  individ¬ 
ual  program  will  contribute  to  the 
achievement  of  higher  weapon  system 
availability  and  supportability  through 
the  integration  and  automation  of  a 
large  portion  of  the  acquisition  and 
support  process.  As  a  benefit  of  this 
automation,  weapon  system  funding  can 
be  redirected  from  costly  redesign  and 
maintenance  to  the  acquisition  of  addi¬ 
tional  systems. 

The  scope  of  this  area  of  work  includes 
the  technological  components  of  engine¬ 
ering  information  support.  These  com¬ 
ponents  are  applicable  to  the  entire 
weapon  system  acquisition  process  from 
early  conceptual  studies  through  analy¬ 
sis,  design,  planning,  and  support  of 
fielded  systems.  Technical  emphasis 
is  on  computer  applications,  mathemat¬ 
ical  algorithms,  structured  information 
flow  processes,  and  development  of 
technology  transition  strategies. 

Significant  components  of  the  process 
include  CALS,  Automated  Technical  In¬ 
formation  (ATI),  R&M  analysis,  Logis¬ 
tics  Support  Analysis  and  Records  (LSA/ 
LSAR) ,  engineering  configuration  man- 


agement  and  life-cycle  cost,  and  ergo¬ 
nomic  Manpower,  Personnel,  and  Train¬ 
ing  (MPT)  factors  involved  in  design 
and  unified  life-cycle  engineering. 
Weapon  system  emphasis  will  be  upon 
aeronautic  systems;  however,  the  tech¬ 
nological  R&D  products  will  be  appli¬ 
cable  to  other  defense  systems.  Speci¬ 
fic  examples  of  these  technological 
components  will  occur  in  three  areas: 
design  analysis  models  (e.g.,  CREW 
CHIEF)  and  their  application  in  comput¬ 
er-aided  design  (RAMCAD) ;  logistics 
support  analysis  (Unified  Database  for 
Acquisition  Logistics)  database  automa¬ 
tion;  and  information  support  (Integra¬ 
ted  Design  Support  Systems  and  Automa¬ 
ted  Information  Technology). 

The  planned  R&D  will  influence  a  number 
of  variables  within  the  acquisition 
cycle.  These  variables  are  classified 
into  four  categories:  acquisition  man¬ 
agement,  planning,  design  and  analysis, 
and  data  and  information  management. 

Each  of  these  variables  is  comprised 
of  a  number  of  important  components. 
Acquisition  management  includes  con¬ 
tract  requirements,  specifications  and 
standards,  management  control  proce¬ 
dures,  Defense  Systems  Acquisition  Re¬ 
view  Council/Air  Force  Systems  Acquisi¬ 
tion  Review  Council  criteria  and  con¬ 
tent,  and  major  system  documentation 
such  as  the  Air  Force  Program  Objec¬ 
tives  Memorandum,  the  Decision  Coordi¬ 
nating  Paper  and  the  Integrated  Logis¬ 
tics  Support  Plan.  Planning  includes 
elements  such  as  forecasting  models, 
maintenance  and  logistics  concepts, 
unit  manning  structures,  and  training 
program  requirements.  The  design  and 
analysis  variables  include  specific 
elements  such  as  mathematical  CAD  tech¬ 
niques,  design  goals  and  criteria, 
trade-off  parameters  and  procedures, 
and  design  review  objectives  and  proce¬ 
dures.  The  data  and  information  man¬ 
agement  variables  includes  structured 
analysis  of  data  content  and  systems, 
data  timeliness  and  information  avail¬ 
ability,  data  exchange  specifications 
and  standards,  data  flow  processes,  and 
storage  and  retrieval  mechanisms. 


Reliability,  Availability,  and  Main¬ 
tainability  in  Computer-Aided  Design 
(RAMCAD) 

In  order  to  meet  the  operational  objec¬ 
tives  as  described  in  Air  Force  2000, 
significant  improvements  in  the  sup- 
portability  of  Air  Force  weapon  systems 
are  required.  R&M  must  be  designed 
into  weapon  systems  early  in  the  design 
process.  The  objective  of  RAMCAD  is 
to  develop  technology  to  accomplish 
this  through  the  use  of  Computer-Aided 
Engineering  (CAE). 

Use  of  advanced  information  processing 
and  display  technology  applied  to  CAE 
models  and  data  will  result  in  more  re¬ 
liable  and  maintainable  weapon  systems. 
Improved  R&M  will  significantly  lower 
system  life-cycle  costs  and  result  in 
higher  states  of  combat  readiness.  Oth¬ 
er  direct  benefits  include:  a  more 
efficient  design  process,  more  explicit 
trade-offs  in  the  design,  and  better 
R&M  analysis  techniques  which  can  be 
implemented  throughout  the  design  phase 
of  weapon  system  acquisition. 

There  are  three  major  activities  which 
will  be  accomplished  under  this  effort: 
(1)  technology  demonstrations;  (2)  de¬ 
velopment  of  a  RAMCAD  consortium  of 
leading  industrial,  academic  and  DOD 
agencies;  and  (3)  establishing  a  meth¬ 
odology  for  communication  and  informa¬ 
tion  transfer  among  the  diverse  and 
numerous  agencies  involved  in  RAMCAD 
relevant  technology  development  and 
application  programs.  Each  of  these 
activities  is  discussed  below. 


Demonstrations :  A  series  of  tech¬ 
nology  demonstrations  have  already  been 
accomplished,  and  others  are  planned, 
to  show  the  benefit  of  using  CAE  to  ad¬ 
dress  R&M  problems  on  existing  weapon 
systems.  One  demonstration  was  comple¬ 
ted  in  FY83  as  part  of  the  redesign  of 
the  Ground  Launched  Cruise  Missile 
(GLCM)  turbine  engine.  The  GLCM  demon¬ 
stration  resulted  in  an  estimated  8Z 
improvement  in  the  availability  of  the 


turbine.  In  another  demonstration,  a 
computer  graphics  model  of  an  F-15E  is 
being  created  along  with  a  model  of  a 
TAB-VEE  shelter  and  the  appropriate 
support  equipment.  This  graphic  model 
will  then  be  exercised  to  simulate  sev¬ 
eral  reconfiguration  scenarios,  with 
the  F-15E  loaded  with  different  weapons 
and  support  stores.  The  intent  is  to 
graphically  analyze  loading  require¬ 
ments,  shelter  clearances,  and  support 
equipment  positioning  to  ensure  they 
are  sufficient  to  allow  quick  turn¬ 
around  within  the  limited  space  and 
time  constraints  presented  by  a  war¬ 
time  environment. 


RAMCAD  Advisory  Group:  The  RAMCAD 
consortium  includes  organizations  from 
industry,  Government,  and  academia, 
all  working  toward  acceleration  of 
technology  development,  demonstration, 
and  use  of  RAMCAD  tools  and  techniques 
for  DOD  applications.  Originally  con¬ 
ceived  by  the  Joint  Logistics  Command¬ 
ers'  Subpanel  on  RAMCAD,  the  consortium 
has  three  tasks:  (a)  integrate  R&M 
analyses  into  commercially  available 
CAE;  (b)  conduct  long-term  R&D  into 
computer  science  and  R&M  analyses  as 
they  apply  to  next-generation  RAMCAD; 
and  (c)  develop  engineering  curricula 
that  include  RAMCAD  as  an  integral  part 
of  academic  training.  This  joint  ef¬ 
fort  is  being  directed  by  a  tri-Service 
committee  with  technical  participation, 
direction/guidance,  and  funding  from 
the  Air  Force  and  Army.  This  technol¬ 
ogy  development  and  integration/demon¬ 
stration  forms  the  foundation  for  our 
Unified  Life-Cycle  Engineering  work 
(Project  Forecast  II,  PT-32)  described 
on  page  30. 

Communication  and  Information  Tran¬ 
sition:  Interagency  communication 
activities  are  of  two  types:  technical 


During  FY86,  the  National  Security  In¬ 
dustrial  Association  (NSIA)  Maintenance 
and  Logistics  Factors  in  Computer-Aided 
Design  (MLCAD)  project  was  completed, 
the  first  part  of  the  F-15E  demonstra¬ 
tion  was  continued,  the  RAMCAD  consor¬ 
tium  was  started,  the  first  IDA  Techni¬ 
cal  Interchange  Meeting  (TIM)  was  held, 
and  two  RAMCAD  Bulletins  (Newsletters) 
were  published  and  distributed. 

Looking  to  FY87,  the  F-15E  demonstra¬ 
tion  should  reach  completion,  the 
RAMCAD  Bulletin  will  continue  publica¬ 
tion  on  an  approximate  quarterly  basis, 
and  the  RAMCAD  Consortium  project  will 
be  awarded  by  1  April  1987.  Addition¬ 
ally  the  IDA  will  be  held  semiannually. 


Contact:  Mr.  Alan  E.  Herner 
AFHRL/LRA 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-3871 
AUTOVON  785-3871 


Budget  constraints,  coupled  with  the 
increasing  cost  of  advanced  weapon  sys¬ 
tems,  make  clear  the  need  to  bring  ac¬ 
quisition  and  maintenance  costs  under 
control.  Both  of  these  actions  must 
occur  while  sustaining  and/or  increas¬ 
ing  combat  availability  of  the  weapon 
system.  These  objectives  are  consist¬ 
ent  with  and  support  Air  Force  2000, 
which  emphasizes  increased  Reliability 
and  Maintainability  goals  for  tomor¬ 
row's  systems.  To  achieve  these  goals, 
significant  additional  tools  must  be 
developed  for  use  during  system  design. 
These  design  tools  must  emphasize  en¬ 
hancing  the  capability  to  design  for 
increased  maintainability.  New  design 
tools  which  consider  all  aspects  of 


CREW  CHIEF  (Computer  Model  of  an 
Aircraft  Technician) 


interchange  meetings  being  held  at  the 
Institute  for  Defense  Analysis  (IDA) 
and  a  newsletter  published  under  the 
auspices  of  the  Joint  Logistics  Com¬ 
manders'  Subpanel  on  RAMCAD. 


weapon  system  maintainability  can  sig¬ 
nificantly  reduce  the  amount  of  avoid¬ 
able  design-involved  maintainability 
problems  currently  found  now  during 
actual  system  fielding  and  employment 


and  consequently,  reduce  overall  system 
life  cycle-costs. 

CREW  CHIEF  is  a  computer-based,  anthro¬ 
pometric  computer  graphics  design  and 
analysis  tool.  It  puts  "people"  into 
computers.  It  can  be  used  by  designers 
to  actually  portray  and  simulate  main- 


AUTOMATED  ACCESSIBILITY  ANALYSIS 
POINTS  TO  INTERFERENCE 

ing  early  stages  of  the  design  cycle. 
CREW  CHIEF  gives  the  design  engineer 
the  on-line  capability  to  analyze  the 
design  for  maintainability  for  new 
weapon  systems  or  to  analyze  changes 
to  equipment  or  procedures  for  existing 
systems.  This  significant  technology 
is  being  developed  in  cooperation  with 
AAMRL  and  will  allow  early  identifi¬ 
cation  of  potential  or  actual  design- 
induced  maintainability  problems  so 
that  corrective  actions  are  taken 
before  mockup,  fabrication,  or  produc¬ 
tion.  The  ability  to  do  on-line  inter¬ 
active  maintainability  and  accessi¬ 
bility  design  trade-offs  without  the 
need  for  a  hard  mockup  is  a  major  ad¬ 
vance  over  current  design  methods.  CREW 
CHIEF  holds  the  clear  potential  not 
only  to  reduce  developmental  engineer¬ 
ing  costs  but  to  provide  the  opportun¬ 
ity  to  reduce  acquisition  time,  main¬ 
tenance  time,  and  life-cycle  costs 
while  increasing  system  availability 
for  the  Air  Force. 


The  specific  technology  development/ 
integration  objective  of  CREW  CHIEF  is 
to  develop  three-dimensional  computer 
graphics  models  for  aircraft  mainte¬ 
nance  technicians  (male/female  from 
the  5th  to  95th  percentiles).  These 
models  will  interface  with  state-of- 
the-art  CAD/CAM  packages  to  allow 
on-line  analyses  of  design  for  mainten¬ 
ance.  Extensive  experimental  research 
is  being  conducted  to  collect  ergonomic 
data  to  populate  the  database.  This 
database  is  unique  to  CREW  CHIEF  since 
minimal  ergonomics  data  on  human  capa¬ 
bilities  related  to  maintenance  activi¬ 
ties  previously  existed.  When  fully  de¬ 
veloped,  these  models  and  supporting 
databases  will  include  quantitative 
metrics  on  human  capabilities  (such  as 
range  of  body  size,  strength,  reach, 
vision,  and  lifting  abilities).  It 
will  also  contain  library  programs  on 
common  handtools,  task  analysis,  man¬ 
ual  material  handling  analysis,  inter¬ 
ference  analysis,  visual  field  analy¬ 
sis,  and  encumbrance  of  clothing  (fat¬ 
igue  jacket,  Arctic  gear,  chemical  de¬ 
fense)  . 
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During  FY86,  a  number  of  CREW  CHIEF 
functional  capabilities  were  achieved. 
These  included:  (a)  12  different  main¬ 
tenance  postures;  (b)  1st  to  99th  per¬ 
centile  male/female  anthropometric  di¬ 
mensions;  (c)  enfleshment  for  fatigue, 
cold  weather,  and  chemical  defense 
clothing;  (d)  visibility  analysis;  and 
(e)  interference  analysis. 


increase  the  productivity  of  logisti¬ 
cians  involved  in  the  systems  acquisi¬ 
tion  process;  (c)  improve  the  quality 
of  logistics  data  items  used  for  plan¬ 
ning  training,  support  equipment, 
spares,  etc.;  and  (d)  reduce  the  cost 
and  time  required  to  prepare  and  inte¬ 
grate  data  generated  by  physically  sep¬ 
arated  logisticians  and  engineers. 


During  FY87,  we  plan  to  complete  and 
validate  the  remaining  database  and 
validate  a  fully  capable  model.  Re¬ 
lease  of  the  database  and  analysis  mod¬ 
els  is  expected  to  occur  during  the 
second  quarter  of  FY88. 

Contact:  Capt  Everton  R.  Wallace 
AFHRL/LRA 

Wright-Patterson  AFB,  OH  45433 
Commercial  (513)  255-3871 
AUTOVON  785-3871 


Unified  Data  Base  (UDB)  for 
Acquisition  Logistics 

Modern  weapon  systems  are  combinations 
of  complex  hardware  and  software  sub¬ 
systems.  Full  design  and  operational 
data  on  a  weapon  system  are  inherently 
complex,  voluminous,  and  rarely  used 
or  stored  in  one  physical  location. 
Data  communication  gaps,  in  the  form 
of  inconsistent  or  inaccessible  data, 
can  prevent  the  timely  dissemination 
of  accurate  data  needed  to  make  valid 
supportability  planning  decisions  dur¬ 
ing  the  system  acquisition  and  fielding 
process . 

Successful  completion  of  this  effort 
will  produce  a  data  information  and  de¬ 
cision  support  system  which  will  enable 
logisticians  and  engineers  to  rapidly 
and  efficiently  document,  retrieve,  and 
query  a  central  database  on-line  via  a 
computer  terminal.  The  ability  to  per¬ 
form  on-line  data  access  will  have  the 
following  significant  impacts  on  the 
the  supportability  planning  process: 
(a)  enhance  the  validity  of  integrated 
logistics  support  analysis  data;  (b) 


The  UDB  is  a  Logistics  Support  Analysis 
database  system  designed  to  improve  the 
documentation  and  accessibility  of  ac¬ 
quisition  logistics  support  data.  UDB 
conforms  to  MIL-STD-1388-2A  and  auto¬ 
mates  all  the  data  elements  of  the 
standard,  through  the  addition  of  data 
elements  supplemental  to  the  military 
standard.  The  system  may  also  be  used 
to  automate  common  acquisition  data 
items . 

The  software  was  essentially  completed 
in  1986.  Final  documentation,  valida¬ 
tion  by  the  Army  Materiel  Readiness  and 
Support  Activity,  and  internal  verifi¬ 
cation  and  validation  by  AFHRL  is  plan¬ 
ned  for  1987,  with  full  transition  in 
early  1988. 

Contact:  Capt  Everton  R.  Wallace 
AFHRL/LRA 

Wright-Patterson  AFB  OH  45433 
Commercial  (513)  255-3871 
AUTOVON  785-3871 


Integrated  Information  Systems 
Engineering  Methodology 

Aerospace  contractors  and  the  Air  Force 
currently  rely  on  ever-increasing 
amounts  of  computerized  data  to  perform 
their  respective  functions  during  sys¬ 
tem  design,  acquisition,  and  deploy¬ 
ment.  Specifically,  these  computerized 
data  are  critical  to  R&D,  design,  pro¬ 
curement,  management,  maintenance,  lo¬ 
gistics  support,  and  operations  life- 
cycle  activities  of  Air  Force  weapon 
systems.  At  this  time,  access  to  these 
data  is  through  multiple  and  typically, 
dissimilar  computer  systems.  These 


data  storage  and  processing  systems  are 
usually  developed  based  on  existing 
policy,  available  funding,  current 
technology,  and  individual  user  re¬ 
quirements,  without  an  overall  inte¬ 
grating  or  systems  engineering  method¬ 
ology.  This  has  resulted  in  a  multi¬ 
plicity  of  unique  systems  without  com¬ 
mon  specifications  or  standards  for 
computer  hardware,  software,  communica¬ 
tions,  or  data.  This  ensures  that 
these  systems  cannot  share  information 
or  data.  Current  information  systems 
design  methodology  and  technology  are 
divided  functionally  into  vertical  seg¬ 
ments  such  as  information,  hardware, 
software,  and  communications  engineer¬ 
ing.  A  methodology  encompassing  all 
these  functional  areas  is  needed  for 
design,  production,  operation,  and  sup¬ 
port  of  large-scale,  distributed,  het¬ 
erogeneous  information  systems. 

Successful  completion  of  this  effort 
will  produce  a  support  system  environ¬ 
ment  for  integrated  information  systems 
development.  The  support  system  envi¬ 
ronment  will  consist  of  the  methodol¬ 
ogy,  techniques  (methods/practices), 
and  tools  (mechanisms):  (a)  to  ensure 
the  success  of  integrated  information 
systems  development,  (b)  to  increase 
the  productivity  of  the  project  teams 
involved  in  systems  development,  (c) 
to  improve  the  quality  of  the  life- 
cycle  products  of  the  development  team, 
and  (d)  to  reduce  the  cost  and  time  re¬ 
quired  for  integrated  information  sys¬ 
tem  development. 


Establishment  of  a  complete  system  de¬ 
velopment  methodology  is  a  complex  sys¬ 
tem  development  effort  in  itself.  The 
key  is  to  develop  a  common  core  of 
methods  which  are  modular  and  which  in¬ 
terlock  in  a  consistent  fashion  to 
cover  the  entire  life  cycle  of  the  sys¬ 
tem  being  developed.  Surrounding  this 
core  there  must  be  a  set  of  techniques 
for  dealing  with  the  viewpoint  of  a 
particular  problem  area  or  application 
technology.  This  effort  will  analyze 
the  experience  base  in  integrated  in¬ 
formation  system  engineering  projects 
to  capitalize  on  the  discoveries  of 
current  practitioners  of  existing  sys¬ 
tem  development  methodologies.  Defi¬ 
ciencies  and  workaround  techniques  will 
be  identified,  and  a  baseline  model  of 
system  development  activities  and  in¬ 
formation  will  be  established.  From 
this  baseline  and  the  experience  base, 
the  methodological  needs  will  be  iden¬ 
tified  and  critical  R&D  areas  estab¬ 
lished.  This  will  serve  as  the  founda¬ 
tion  for  development  of  the  final  inte¬ 
grated  information  systems  engineering 
methodology. 

Work  will  begin  in  late  1986,  and  re¬ 
sults  will  be  transitioned  to  the  IDS 
advanced  development  program,  a  joint 
undertaking  led  by  the  AFWAL  Flight 
Dynamics  Laboratory. 

Contact:  Maj  Paul  D.  Condit 

AFHRL/LRA 

Wright-Patterson  AFB  OH  45433 

Commercial  (513)  255-3871 

AUTOVON  785-3871 
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Colonel  Gene  A.  Berry 
Division  Chief 


TRAINING  SYSTEMS  DIVISION 


The  Training  Systems  Division  has  com¬ 
pleted  a  move  from  Lowry  AFB,  Colorado 
to  Brooks  AFB,  Texas.  At  the  close  of 
calendar  year  1986,  all  Division  per¬ 
sonnel  are  located  either  at  Brooks  AFB 
or  at  the  remaining  operating  location 
at  Bergstrom  AFB  near  Austin,  Texas. 
The  primary  objective  of  the  Training 
Systems  Division  is  to  perform  Research 
and  Development  (R&D)  to  enhance  Air 
Force  skill  development  and  job  per- 


Branch 


formance  through  improved  training 
methods,  devices,  management  and  as¬ 
sessment.  In  addition,  the  Division 
has  been  designated  the  Laboratory  cen¬ 
ter  for  artificial  intelligence  R&D 
and,  in  particular,  its  applications  to 
Air  Force  training. 


To  better  accomplish  its  mission,  the 
Division  has  been  reorganized  as  four 
branches,  each  named  for  its  R&D 
thrust:  the  Training  Technology  Branch, 
Skills  Development  Branch,  Intelligent 
Systems  Branch,  and  On-the-Job  Train¬ 
ing  Branch. 


Dr.  Hendrick  W.  Ruck 
Technical  Advisor 


The  Division's  R&D  efforts  are  current¬ 
ly  focused  on  five  major  projects  or 
thrusts.  The  major  focus  of  each  branch 
is  as  follows: 


Projects 


Training  Technology 


Instructional  Support  System 


Skills  Development 


Job  Performance  Measurement 
Training  Decisions  System 


Intelligent  Systems 


Applications  of  Artificial 
Intelligence  to  Training 


On-the-Job  Training 


Advanced  On-the-Job  Training  Systea 
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Training  Technology  Branch 

The  mission  of  the  Training  Technology 
Branch  is  to  perform  R&D  on  methods  and 
techniques  for  improving  the  training 
effectiveness  of  the  Air  Force.  At 
present,  the  branch  is  rebuilding  its 
staff  while  continuing  to  work  in  the 
area  of  computer-based  training.  The 
major  ongoing  effort  is  the  Instruc¬ 
tional  Support  System  (ISS). 

Instructional  Support  System  (ISS) 

Efforts  to  check  out  and  properly 
"field"  the  ISS  for  broad  Air  Force¬ 
wide  use  comprised  most  of  the  action 
of  the  new  Training  Technology  Branch. 
Early  Training  Systems  Division  R&D  ef¬ 
forts  in  Computer-Based  Training  (CBT) 
in  the  1970s  produced  the  Advanced  In¬ 
structional  System  (AIS).  The  AIS  was 
designed  to  train  and  manage  a  large 
number  of  students  using  a  mainframe 
computer;  consequently,  its  implemen¬ 
tation  resulted  in  costly  hardware  and 
software  dependency. 


In  the  early  1980s,  multiple  non¬ 
standard  CBT  systems  emerged  along  with 
microcomputers.  The  ISS  was  developed 
to  meet  these  new  challenges,  and  it 
ultimately  became  the  successor  to  AIS. 
The  ISS  consists  of  two  major  compo¬ 
nents:  Computer-Assisted  Instruction 
(CAI)  and  Computer-Managed  Instruction 
(CMI).  ISS  is  Government-owned  and  is 
written  in  Ada,  the  standard  DOD  pro¬ 
gramming  language.  The  use  of  Ada 
enables  ISS  to  be  rehosted  to  a  variety 
of  machines,  ranging  from  mainframes 
to  microcomputers.  ISS's  modular  con¬ 
struction  makes  it  possible  to  load  the 
entire  system  simultaneously  or  in  por¬ 
tions,  depending  on  the  user’s  need. 

The  Air  Force  accepted  ISS  as  a  proto¬ 
type  on  the  VAX  11/780  minicomputer  in 
October  1985.  This  year,  the  Strategic 
Air  Command  (SAC)  at  Dyess  AFB,  Texas 
has  served  as  the  Operational  Test  and 
Evaluation  (OT&E)  site,  using  ISS  to 
develop,  deliver,  and  manage  aircrew 
training  for  the  B-1B. 


INSTRUCTIONAL  SUPPORT  SYSTEM 
FOR 

AIR  FORCE  COMPUTER  JASED  TRAINING 
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ISS  was  rehosted  from  an  early  Ada  com¬ 
piler  version  to  a  validated  Ada  com¬ 
piler  in  September  1986,  making  it  a 
more  stable  and  maintainable  product. 
In  addition,  a  number  of  software  prob¬ 
lems  were  corrected,  several  CMI  en¬ 
hancements  were  added,  and  a  training 
package  was  developed  in-house  that 
provides  on-line  instruction  for  using 
the  system  to  develop  CAI  courseware. 

Efforts  are  underway  to  develop  an  on¬ 
line  training  package  for  designing  and 
managing  curricula  using  the  CMI  com¬ 
ponent.  In  addition,  the  application 
software  is  being  documented  to  aid  in 
transitioning  the  software  to  a  long¬ 
term  support  agency.  A  state-of-the- 
art  videodisc  interface  will  be  devel¬ 


being  developed  which  will  be  compact 
enough  to  run  on  a  microcomputer,  yet 
powerful  enough  to  track  student  pro¬ 
gress  and  preserve  the  data  required 
to  evaluate  instructional  effective¬ 
ness.  Rehosting  ISS  to  the  Zenith  248 
and  micro  VAX  II  have  been  initiated. 
If  the  Zenith  248  venture  is  success¬ 
ful,  ISS  could  then  provide  the  basic 
architecture  for  a  standard  Air  Force¬ 
wide  CBT  system. 

The  demand  for  ISS  is  extensive.  ISS 
will  be  the  CBT  core  for  both  the 
Advanced  Training  System  (ATS)  for  Air 
Training  Command's  (ATC)  Technical 
Training  Centers  and  the  Advanced  On- 
the-job  Training  System  (AOTS).  In 
addition,  it  is  being  used  as  the  basic 


oped  soon.  Also,  a  CMI  component  is 


software  for  the  General  Imagery 


OSSQr y 


Pod  0  to  reu leu 


G  for  G 1 


This  is  the  which  provides  an 

aircraft  reference.  The  symbol  Is  fixed,  so  the 
presented  displays  will  rotate  around  It. 


hf  TIIPN  t  o  go  on;  C  to  comment  on  mater  lol 


fore  hands  on  training  m  simulators  or  cockpit 
ock-ups ,  B-1B  aircrew  students  train  on  the  ISS. 


Pilot's  Vertical  Display  in  B-1B  aircraft  presents 
attitude,  altitude,  airspeed,  and  navigation  data. 


Intelligence  Training  System  (GIITS)  at 
the  Electronic  Systems  Division  at 
Hanscom  AFB.  Also  using  ISS,  the  ATC 
at  Lowry  AFB  developed  20  hours  of 
Electronics  Principles  instruction;  the 
6575th  School  Squadron  at  Brooks  AFB  is 
using  the  ISS  to  demonstrate  the  feasi¬ 
bility  of  CBT  in  its  Computer  Resources 
Acquisition  Course;  and  SAC  is  expand¬ 
ing  its  B-lB  instruction  to  its  main 
operating  bases,  using  ISS  on  the  Micro 
VAX  II. 

Many  other  Air  Force  training  managers 
have  expressed  an  interest  in  ISS,  and 
this  demand  highlights  the  need  for  a 
permanent  agency  to  maintain  and  sup¬ 
port  ISS.  Progress  is  being  made  in 
identifying  such  an  agency. 

Contact:  Ms.  Barbara  Eaton 
AFHRL/IDC 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-3992 
AUTOVON  240-3992 


Skills  Development  Branch 

The  Skills  Development  Branch  conducts 
exploratory  and  advanced  R&D  programs 
to  improve  the  acquisition  and  main¬ 
tenance  of  job-related  skills.  Pre¬ 
sently,  these  programs  include  the 
Training  Decisions  System  (TDS),  a  com¬ 
puterized  database  and  resource  allo¬ 
cation  model  designed  to  help  training 
managers  make  training  program  and 
budget  decisions,  and  the  Job  Perform¬ 
ance  Measurement  System,  a  methodology 
for  collecting  accurate  and  reliable 
performance  information  to  determine 
the  extent  of  skills  acquisition  and 
training  program  effectiveness.  Future 
programs  will  include  other  technol¬ 
ogies  to  improve  the  efficiency  and 
effectiveness  of  Air  Force  training 
programs . 
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Training  Decisions  System  (TPS) 

A  basic  problem  in  developing  overall 
training  programs  and  policies  for  Air 
Force  career  ladders  is  deciding  what 
to  train  (training  content  decisions), 
where  to  train  (appropriate  settings), 
and  when  to  train  (at  various  points 
throughout  an  airman's  career).  Due 
to  the  scope  and  complexity  of  Air 
Force  training,  many  decisions  with 
major  impacts  on  training  must  be  made 
independently  by  management  without 
the  benefit  of  coordination  and  rele¬ 
vant  data. 

The  TDS  is  being  developed  to  provide 
a  more  unified  and  integrated  approach 
to  solving  training  problems.  TDS 
integrates  job  tasks,  manpower,  and 
cost  considerations  into  a  single 
comprehensive  model.  Specifically,  TDS 
uses  information  obtained  about  job 
tasks  performed  by  airmen,  combined 
with  personnel  assignment  information, 
to  evaluate  the  training  capacities  of 
Air  Force  settings  to  determine  what 
cost-saving  training  and  utilization 
options  are  available. 

TDS  is  a  multiyear,  mu It imi l lion-do 1- 
lar  R&D  effort  consisting  of  four  re¬ 
search  components.  The  Task  Charac¬ 
teristics  component  is  designed  to 
develop  computerized  task-clustering 
techniques  based  on  Occupational  Survey 
report  data.  The  Field  Utilization 
component  will  compare  and  contrast 
present  and  alternative  personnel  uti¬ 
lization  and  assignment  patterns  and 
the  impact  of  each  on  training.  The 
Resource/Cost  component  will  address 
available  resources,  assess  training 
capacity,  and  determine  cost  trade¬ 
offs  associated  with  training  in  var¬ 
ious  settings.  The  Integration/Opti¬ 
mization  component  will  integrate  the 
three  individual  components  into  a 
computerized  decision  support  system. 

A  four-year  exploratory  development 
contract  that  began  in  September  1983 
is  addressing  a  representative  sample 
of  Air  Force  specialties:  (Avionic 


Inertial  and  Radar  Navigation  Systems, 
Security/Law  Enforcement,  Aircraft 
Environmental  Systems,  Electronic 
Computer  and  Switching  Systems).  A 
portable  computerized  demonstrator  is 
being  used  to  allow  potential  users  at 
Air  Staff,  HQ  Air  Training  Command, 
and  Major  Command  training  offices  to 
review  and  validate  design  concepts. 
A  computerized,  statistically  genera¬ 
ted,  task  clustering  procedure  has 
been  created  to  generate  modules  with 
tasks  which  are  to  be  trained  together 
based  upon  their  co-performance  in  ac¬ 
complishing  a  job.  An  advanced  devel¬ 
opment  contract  will  consider  addition¬ 
al  specialties  and  provide  for  the 
transition  of  the  TDS  to  an  Air  Force 
operational  unit. 

The  TDS  will  save  training  time  and 
reduce  costs  by  increasing  efficien¬ 
cies  in  the  structure  of  the  Air  Force 
personnel  and  training  system.  By  pro¬ 
viding  better  training,  the  mission 
readiness  of  the  Air  Force  will  be  im¬ 
proved.  The  TDS  database  will  also  be 
an  invaluable  asset  for  updating  or 
initially  determining  contingency  plans 
by  having  available  a  wealth  of  current 
information  from  which  accurate  deci¬ 
sions  can  be  made.  Finally,  TDS  will 
provide  up-to-date  information  to  Air 
Force  managers  and  provide  a  modeling 
capability  to  address  "what  if"  train¬ 
ing  questions. 

Contact:  Maj  Daniel  L.  Collins 

AFHRL/IDE 

Brooks  AFB  TX,  78233-3601 

Commercial  (512)  536-3047 

AUT0V0N  240-3047 


Job  Performance  Measurement 

The  objective  of  Air  Force  job  perform¬ 
ance  measurement  R&D  is  to  develop  a 
technology  for  accurately  measuring  job 
performance.  Such  a  technology  will  be 
used  to  enhance  the  prediction  of  job 
success  for  improving  Air  Force  selec¬ 
tion  and  training  programs. 


JOtNT-SERViCE 

JOt  PERFORMANCE  MEASUREMENT  PROJECT  STRATEGY 


Historically ,  enlistment  standards  and 
selection/classification  decisions  have 
been  linked  to  training  outcomes.  Sim¬ 
ilarly,  other  career  point  decisions 
have  been  based  on  highly  subjective 
supervisory  ratings,  rather  than 
againat  actual  on-the-job  performance. 
Linking  enlistment  standards  and  other 
personnel  actions  directly  to  measures 
of  job  performance  would  result  in  more 
for  our  manpower  dollars  by  selecting 
the  best-qualified  applicants  and 
assigning  them  to  jobs  in  which  they 
are  likely  to  succeed. 

The  job  performance  measurement  project 
should  have  widespread  benefits  for  the 
Air  Force.  This  impact  is  clear  in 
three  areaa : 

Firat,  aelection  of  recruits  will 
improve  after  establishing  a  posi¬ 
tive  link  between  selection  tests 
and  performance  on  the  job.  This 
improvement  takes  the  form  of 
greater  accuracy  in  selection  and 
clasaif ication  of  personnel.  By 


improving  the  accuracy  of  recruit¬ 
ing  and  classification,  it  will  en¬ 
sure  the  selection  of  the  best- 
qualified  applicants  for  jobs  where 
their  skills  can  be  fully  utilized. 
Air  Force  members  are  then  more 
likely  to  succeed  and  re-enlist. 

Second,  training  programs  will  also 
benefit  from  the  performance  meas¬ 
urement  technology.  Program 
designers  will  be  able  to  use 
actual  job  performance  as  a  basis 
for  comprehensive  training  analy¬ 
sis,  thereby  improving  the  evalua¬ 
tion  and  development  of  training 
programs.  This  strategy  can  apply 
to  both  on-the-job  and  technical 
training. 

Third,  such  system  improvements 
will  result  in  more  productive  and 
satisfied  personnel;  higher  re¬ 
enlistment  rates;  and  lower  selec¬ 
tion,  training,  and  personnel  re¬ 
placement  costs.  By  improving  the 
performance  of  the  most  important 


part  of  the  Air  Force  -  its  people  - 
this  technology  will  improve  Air  Force 
readiness . 

Current  Air  Force  efforts  involve  the 
development  of  a  Job  Performance  Meas¬ 
urement  System  (JPMS)  for  eight  Air 
Force  specialties  (AFSs).  The  JPMS 
consists  of  a  hands-on  work  sample 
testing  technique  and  a  variety  of 
substitute  job  performance  measures. 
The  most  detailed,  task-oriented  Air 
Force  measurement  technique  being 
developed  for  the  JPMS  is  called  Walk- 
Through  Performance  Testing  (WTPT). 
This  technique  combines  observation  of 
hands-on  performance  and  incumbent 
interview  testing  procedures  for  a  set 
of  representative  tasks.  Critical 
specialty  and  job-specific  tasks  are 
identified  for  the  WTPT  from  occupa¬ 
tional  survey  data.  Subject-Matter 
Experts  (SMEs)  aid  developers  in  cate¬ 
gorizing  tasks  into  those  for  which 
performance  can  be  economically  ob¬ 
served,  and  those  which  can  be  more 
efficiently  measured  by  interview.  Job 
experts  then  develop  procedures  for 
observing  task  performance  and  specify¬ 
ing  performance  standards  for  scoring 
incumbent  responses.  Because  observa¬ 
tion  of  actual  hands-on  performance  is 
expensive  and  time-consuming,  this  pro¬ 
cedure  will  be  used  as  a  benchmark 
against  which  less  expensive,  easier- 
to-administer  "surrogate"  job  perform¬ 
ance  measures  are  developed. 

The  Air  Force  has  developed  specialized 
expertise  in  the  following  surrogate 
measurement  procedures:  interview 
testing  and  rating  forms.  Rating  forms 
reflect  supervisor,  peer,  and  self 
evaluations  of  an  incumbent's  profi¬ 
ciency.  Rating  forms  also  vary  in 
specificity,  ranging  from  ratings  of 
task  proficiency  to  more  global  meas¬ 
ures  of  technical  and  social/  inter¬ 
personal  competence  on  the  job.  Inter¬ 
view  testing  takes  place  in  the  work 
setting  and  assesses  an  incumbent's 
proficiency  by  allowing  the  incumbent 
to  demonstrate  task-based  knowledge  and 
procedural  strengths  and  weaknesses. 
The  incumbent  does  this  by  providing  a 
combination  of  verbal  responses,  ges¬ 


tures,  and  demonstrations  in  a  "show 
and  tell"  approach. 

The  Air  Force  has  completed  data  col¬ 
lection  and  preliminary  data  analysis 
for  the  first  enlisted  AFS,  Jet  Engine 
Mechanic.  For  this  specialty,  the  in¬ 
terview,  and  the  supervisor  and  peer 
ratings,  all  showed  promise  as  poten¬ 
tial  surrogates  for  hands-on  testing. 
Also,  incumbent  time  in  service,  train¬ 
ing  school  grades,  and  mechanical  ap¬ 
titude  showed  positive,  significant 
relationships  with  hands-on  test  per¬ 
formance.  Other  major  FY86  accomplish¬ 
ments  included: 

Data  collection  was  completed  for 
the  Air  Traffic  Control  Operator, 
Avionic  Communications  Specialist, 
and  Information  Systems  Radio  Oper¬ 
ator  Specialist.  Up  to  300  airmen 
were  tested  in  each  career  field, 
at  a  total  of  45  bases. 

Job  requirements  were  defined  for 
the  final  four  joint-Service  Job 
Performance  Measurement  Project 
AFSs.  These  are:  Aircrew  Life 
Support  Specialist,  Personnel  Spe¬ 
cialist,  Precision  Measuring  Equip¬ 
ment  Specialist,  and  Aerospace 
Ground  Equipment  Specialist. 

The  Air  Force  will  develop  all  the 
Services'  surrogates  on  two  AFSs 
(one  Cross-Service  specialty,  and 
one  Air  Force-unique  specialty). 
This  will  allow  each  Service  to 
gather  additional  performance  in¬ 
formation  at  significant  cost  sav¬ 
ings  and  further  enhance  the  over¬ 
all  joint-Service  job  performance 
measurement  R&D  effort. 

To  summarize,  the  Air  Force  is  develop¬ 
ing  hands-on  job  performance  tests 
along  with  less  expensive  substitute 
tests  to  provide  personnel  and  training 
managers  with  cost-effective  job  per¬ 
formance  measurement  procedures.  Ulti¬ 
mately  this  technology  will  be  used  to 
collect  performance  information  for 
setting  enlistment  (classification) 
standards,  developing  and  evaluating 
training,  and  improving  force  quality. 


psychologists  who  design  training  and 
evaluate  each  system's  efficiency  and 
effectiveness . 


t 


This  technology  will  help  ensure  that 
Air  Force  commanders  and  supervisors 
are  provided  with  personnel  who  have 
the  knowledge  and  skills  required  to 
accomplish  their  mission. 

Contact:  Dr.  Jerry  W.  Hedge 
AFHRL/IDE 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-2932 
AUTOVON  240-2932 


Intelligent  Systems  Branch 

The  objective  of  the  Intelligent  Sys¬ 
tems  Branch  is  to  continue  R&D  in  In¬ 
telligent  Tutorial  Systems  (ITS)  for 
training  efficiency  and  effectiveness. 
The  branch  also  pursues  basic  research 
in  Artificial  Intelligence  (AI)  for 
better  understanding  of  computer-based 
training  applications.  The  Intelligent 
Systems  Branch  takes  a  multidiscipli¬ 
nary  approach  to  artificial  intelli¬ 
gence  R&D  and  considers  this  stance  a 
major  factor  for  producing  a  solid 
technology  base.  The  approach  is  to 
build  an  artificial  intelligence  team 
including  computer  scientists  who  build 
the  software,  engineers  who  build  the 
hardware,  linguists  who  work  with  nat¬ 
ural  human  language  processing  for  com¬ 
puter  understanding,  and  educational 


Projects  are  built  on  a  national 
network  of  researchers  in  DOD,  academ¬ 
ia,  and  industry.  One  cornerstone  ef¬ 
fort  is  the  joint-Service  project  for 
a  knowledge  acquisition  system  and 
intelligent  authoring  aid.  The  purpose 
of  this  effort  is  to  develop  an  ITS 
shell  in  joint-Service  domains.  Also, 
the  intelligent  authoring  aids  will 
allow  an  instructor,  without  computer 
experience,  to  develop  a  course  of 
instruction  in  an  automated  tutoring 
situation.  Intelligent  instructional 
gaming  environments  are  also  underway 
for  embedding  motivational  experiences 
into  ITS,  a  methodology  believed  cap¬ 
able  of  benefit  to  Air  Force  class¬ 
rooms.  An  Associate  Training  Instruc¬ 
tional  Environment  (ATIE)  is  the  gen¬ 
eric  testbed  for  in-house  R&D  as  the 
branch  looks  toward  the  development  of 
multiple-domain  intelligent  training 
systems.  For  example,  an  in-house  R&D 
effort  on  orbital  mechanics  is  being 
developed  for  the  Undergraduate  Space 
Training  School  at  Lowry  AFB,  Colorado. 
Major  interest  in  such  a  project  comes 
from  HQ  Space  Command  and  HQ  Air  Train¬ 
ing  Command.  For  the  long  term,  a 
four-year  project  called  Intelligent 
Computer-Assisted  Training  Testbeds 
includes  more  applied  expert  systems 
and  ITS  R&D  projects.  The  long-term 
goals  are  to  build  the  best  in  ITS  for 
the  Air  Force  2000 's  complex,  high 
tech  jobs. 

IMTELLIGOiT  SYSTEMS 
FOB  HUMAN  RESOURCES 
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Artificial  Intelligence  R&D  Will  Enhance  Training  and  Instruction 


For  the  branch,  a  major  role  is  seen 
for  implementing  knowledge-based  sys¬ 
tems  R&D.  In  fact,  General  Skantze, 
AFSC  Commander,  initiated  Project  Fore¬ 
cast  II  meetings  over  a  six-month 
period  to  determine  the  next  20  years 
of  R&D  relative  to  preparation  for  Air 
Force  2000  technological  advances.  One 
such  R&D  issue  is  "Knowledge-Based  Sys¬ 
tems,"  in  which  AI  technologies  for  Air 
Force  training  are  demonstrated  -  new 
reasoning  algorithms  and  machine  learn¬ 
ing  to  be  specific.  General  Skantze 
indicated  "loud  and  clear"  that  artifi¬ 
cial  intelligence  payoffs  should  be 
demonstrated . 


Knowledge  Acquis  it  ion/ Intelligent 
Authoring  Aids 

The  goals  are  to  design  and  develop  in¬ 
telligent  computer-assisted  instruc¬ 
tional  tool 8  and  techniques  for  system 
users  (instructors  and  students).  This 


effort  involves  Army,  Navy,  and  Air 
Force  cooperation  in  a  common-goal  R&D 
project.  All  services  will  benefit  in 
their  R&D  objectives  for  more  efficient 
and  effective  training.  The  project 
is  in  the  second  year  of  a  four-year 
R&D  effort.  Interface  designs  are  com¬ 
pleted  and  specifications  on  the  knowl¬ 
edge  acquisition  system  are  underway. 
Probable  domains  include  space  opera¬ 
tions  and  explosive  ordnance  disposal. 


Contact:  Dr.  Philip  Gillis 
AFHRL/IDEI 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-2981 
AUTOVON  240-2981 


Multiple  Forms  of  Knowledge 
Representation 

The  objective  of  this  R&D  effort  is  tc 
design  a  methodology  for  multiple 


t 


knowledge  representation.  The  goals 
are  to  determine  whether  different 
types  of  knowledge  can  be  represented 
differently  within  a  single  system,  and 
whether  the  output  from  one  system's 
representational  memory  can  be  used  as 
input  to  the  working  memory  of  another 
system.  This  effort  will  provide  sup¬ 
port  to  intelligent  tutorial  systems 
and  expert  systems  R&D.  A  prototype 
Nosocomial  Expert  System  Testbed  for 
Original  Research  (NESTOR)  was  devel¬ 
oped  for  use  in  the  medical  diagnosis 
area  and  its  capabilities  are  to  be 
extended  in  the  Phase  II  follow-on. 

Contact:  Capt  Jeffrey  Noone 
AFHRL/IDEI 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-2981 
AUTOVON  240-2981 


AI  Development  Languages 

The  object  of  this  R&D  was  to  design 
two  expert  systems  using  LISP  and 
PROLOG  languages  and  then  determine 
advantages  and  disadvantages  of  each. 
This  effort  helps  establish  an  AFHRL 
technology  base  for  further  R&D  in  AI. 
The  project  has  been  completed.  A  pro¬ 
totype  Expert  Patient-Ventilator  Man¬ 
ager  (EPVM)  system  was  developed  and 
is  being  tested. 

Contact:  Capt  Kevin  Kline 
AFHRL/IDEI 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-2981 
AUTOVON  240-2981 


The  forum  was  held  in  San  Antcnio, 
Texas,  in  September  1986. 

Contact:  2d  Lt  Charles  Capps 
AFHRL/IDEI 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-2981 
AUTOVON  240-2981 


ANATOMY  OF  AN  INTELLIGENT 
TUTORING  SYSTEM 


STUDENT 


On-the-Job  Training  Branch 

The  On-the-Job  Training  Branch  is  lo¬ 
cated  at  Bergstrom  AFB,  Texas,  under 
the  Tactical  Air  Command.  Its  mission 
is  to  develop  a  prototype  system  that 
can  be  used  in  the  field  to  enable  com¬ 
manders  and  supervisors  to  conduct, 
manage,  and  provide  on-the-job  training 
in  support  of  mission  effectiveness. 
The  branch  is  located  at  Bergstrom  AFB 
so  that  the  prototype  system  can  be  de¬ 
veloped  and  tested  in  the  field. 


The  Advanced  On-the-job  Training 
System  ^AOTS) 


Research  Planning  Forum  For  Intelligent 
Tutoring  Systems  (ITS 7  "" 

This  forum  was  developed  to  give  guid¬ 
ance  to  the  AFHRL  investment  strategy 
for  ITS  and  provide  the  foundation  for 
AI  R&D  initiatives.  This  effort  has 
provided  the  Air  Force  with  a  set  of 
tools  for  efficiently  developing  ITS 
and  has  identified  important  Air  Force 
training  tasks  and  settings  for  which 
implementation  would  be  appropriate. 


The  project  objective  is  to  design,  de¬ 
velop,  demonstrate,  test,  and  evaluate 
a  prototype  Advanced  On-the-job  Train¬ 
ing  System  (AOTS)  for  Air  Force  on-the- 
job  training  (OJT).  AOTS  is  the  Air 
Force  Human  Resources  Laboratory's  ad¬ 
vanced  development  effort  to  build  a 
prototype  state-of-the-art  training 
system  that  integrates  and  effectively 
manages,  evaluates,  and  automates  job 
site  training  to  make  OJT  more  respon¬ 
sive  to  mission  requirements. 


A  well-trained  enlisted  corps  is  criti¬ 
cal  to  Air  Force  mission  accomplish¬ 
ment.  The  majority  of  that  needed 
training  is  provided  by  the  Air  Force's 
OJT  program.  Data  show  that  over  70 
percent  of  technical  training  require¬ 
ments  that  support  unit  missions  are 
met  through  OJT.  The  scope  of  the  Air 
Force's  OJT  program  is  vast.  For 
example,  more  than  80,000  personnel 
are  in  OJT  upgrade  training  at  any 
given  time;  approximately  400  Air  Force 
specialties  are  trained  through  OJT; 
and  OJT  is  conducted  at  all  Air  Force 
locations  worldwide,  including  the  Air 
Force  Reserve  and  Air  National  Guard. 
While  singular  responsibility  for 
training  policy  exists  at  the  Air  Staff 
level  (HQ  USAF/DPPT) ,  OJT  encompasses 
all  functional  areas  and  functional 
managers  play  a  key  role  in  training. 
Qualification  training  conducted  in 
conjunction  with  OJT  at  the  job  site 
includes  more  than  90  percent  of  the 
enlisted  corps.  In  addition  to  the 
vast  scope  of  the  Air  Force  OJT  pro¬ 
gram,  influences  such  as  the  following 
impact  unit  training:  shortages  of 
skilled  technicians;  increasing  mission 
production  demaads;  new  and  upgraded 
weapon  systems;  force  structure  manage¬ 
ment  tactics  and  strategies;  and  in¬ 
creases  in  both  the  number  of  personnel 
routed  directly  into  OJT  and  the  number 
of  tasks  to  be  trained  by  OJT,  due  to 


increasing  resident  training  costs. 
In  short,  the  Air  Force  OJT  program 
must  be  made  to  work  in  this  vast  and 
dynamic  operational  environment  to 
produce  the  trained  personnel  required 
for  mission  accomplishment. 

In  the  mid-70's,  functional  management 
inspections,  senior  management  reviews, 
and  OJT  studies  and  analyses  have  iden¬ 
tified  numerous  operational  deficien¬ 
cies  of  job  site  training.  While  a  num¬ 
ber  of  problem  areas  were  identified, 
the  major  deficiencies  may  be  summa¬ 
rized  as  follows:  inadequate  defini¬ 
tion  of  task  training  requirements; 
inadequate  evaluation  of  task  perform¬ 
ance;  a  burdened,  labor-intensive  proc¬ 
ess;  insufficient  training  management/ 
cost/capacity  data;  and  inadequate  use 
of  automation  technology.  While  dili¬ 
gent  effort  has  produced  some  improve¬ 
ment  in  OJT,  the  kinds  of  factors  pre¬ 
viously  identified  have  combined  to  tax 
OJT  capability,  resulting  in  minimally 
effective  job  site  training.  Conse¬ 
quently,  the  Air  Staff  directed  an  R&D 
effort  to  develop  a  prototype  state-of- 
the-art  Air  Force  OJT  system. 

The  AOTS  prototype  consists  of  five 
major  interrelated  subsystems  that  in¬ 
tegrate  Air  Force  training  management, 
evaluation,  training  development  and 
delivery,  computer  support,  and  person¬ 
nel  and  logistics  subsystems.  The 
management  subsystem  improves  OJT  man¬ 
agement  tools  and  procedures  at  all 
levels  of  the  OJT  process.  Its  major 
components  provide  an  integrated, 
computer-based  OJT  management  system 
which  helps  supervisors  define  job/task 
training  requirements,  manages  airman 
training  progress  towards  position 
qualification,  and  identifies  and  allo¬ 
cates  base-level  resources.  The  evalu¬ 
ation  subsystem  provides  evaluation 
materials,  quality  control  procedures, 
and  data  for  assessing  OJT  capacity  and 
effectiveness.  This  subsystem  provides 
the  instrumentation  and  enhanced  cap¬ 
ability  to  evaluate  airman  task  per¬ 
formance.  In  addition,  the  evaluation 
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Security  Police  On-the-Job  Training 


subsystem's  training  management  infor¬ 
mation  system  provides  data  tailored 
for  all  levels  of  management  (i.e., 
unit,  base,  major  command,  and  Air 
Staff)  to  track  training  quality,  rel¬ 
evance,  and  effectiveness.  The  train¬ 
ing  development  and  delivery  subsystem 
provides  AOTS  with  the  additional  cap¬ 
ability  to  develop  instructional  mate¬ 
rials  and  manage  their  delivery  at  the 
OJT  job  site.  This  subsystem  provides 
the  capability  to  develop  computerized 
instructional  materials.  The  computer 
support  subsystem  applies  state-of-the- 
art  computer  technology  to  support  the 
management  and  evaluation  of  job  site 
training.  This  subsystem  identifies, 
designs,  develops,  and  integrates  the 
hardware  and  software  requirements  to 
support  AOTS.  The  personnel  and  sup¬ 
port  subsystem  specifies  the  qualita¬ 
tive  and  quantitative  personnel  re¬ 
quirements  of  an  operational  AOTS,  as 
well  as  the  requirements  associated 


with  maintenance,  reliability,  logis¬ 
tics,  and  transition  of  the  system. 
This  subsystem  provides  the  necessary 
documentation  for  AOTS  implementation, 
operation,  and  expansion.  The  goal  is 
to  provide  for  smooth  transition  of 
AOTS. 


The  AOTS  prototype  is  a  joint  Air  Force 
and  contractor  effort  and  is  undergoing 
development  in  the  operational  en¬ 
vironment  at  Bergstrom  AFB,  Texas. 
Prototype  execution  is  a  four-year, 
three-phased  effort.  The  design  phase 
fully  details  AOTS  specifications  and 
provides  the  design  documents  for  the 
development  phase.  Phase  II,  the 
development  phase,  is  the  time  during 
which  AOTS  will  be  built.  The  final 
phase,  Operational  Test  and  Evaluation 
(OT&E),  is  12  months  in  duration,  al¬ 
lowing  the  Air  Staff  and  major  com¬ 
mands  to  assess  AOTS  in  the  operational 
environment.  State-of-the-art  technol- 
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Jet  Engine  Mechanic  On-the-Job  Training 


ogy  will  be  systematically  applied  to 
OJT  conducted  in  designated  work  cen¬ 
ters  of  TAC ' s  67th  Tactical  Reconnais¬ 
sance  Wing,  the  147th  Fighter  Intercep¬ 
tion  Group  of  the  Texas  Air  National 
Guard  (Ellington  ANGB),  and  the  924th 
Tactical  Fighter  Group  of  the  Air  Force 
Reserve.  The  enlisted  job  specialties 
used  to  develop  the  prototype  system 
include:  426X2,  Jet  Engine  Mechanic; 
732X0,  Personnel;  431X2C,  Tactical  Air¬ 
craft  Maintenance;  and  811XX,  Security 
Police.  AFHRL  has  20  NCOs  assigned  to 
the  project  on  site  at  Bergstrom  AFB 
to  assist  in  the  development  of  in¬ 
structional  and  evaluation  materials 
and  to  ensure  the  AOTS  will  work  in  the 
operational  environment.  In  addition 
to  the  evaluation  data  resulting  from 
OT&E,  the  evaluation  plan  calls  for  a 
side-by-side  comparison  of  AOTS  and 
current  OJT  system  work  centers.  The 
AOTS  execution  schedule  is  a  challeng¬ 
ing  one,  requiring  concurrent  parallel 
development  of  the  major  AOTS  subsys¬ 
tems. 


AOTS.  Three  levels  of  transition  are 
required.  AOTS  has  been  designed  to 
provide  and  emphasize  the  transition 
of  incremental  products,  payoffs,  and 
implementation  as  the  work  unfolds. 
Examples  of  initial  products  include: 
training  requirements  definition  proc¬ 
esses/lists,  task  proficiency  evalua¬ 
tion  procedures,  training  resources 
identification/scheduling  procedures , 
and  automated  training  records.  Incre¬ 
mental  products  will  be  provided  to  the 
Air  Staff  for  evaluation  and  implemen¬ 
tation  Air  Force-wide.  The  model  AOTS 
at  Bergstrom  AFB,  Texas,  is  to  be  tran¬ 
sitioned  to  the  Tactical  Air  Command 
upon  completion  of  the  project.  Final¬ 
ly,  AOTS  transition  and  implementation 
plans  are  to  be  provided  to  the  Air 
Staff  for  deployment  of  AOTS  Air  Force¬ 
wide. 

The  AOTS  effort  is  currently  underway 
and  all  start-up  and  support  activities 
have  been  completed.  The  site  was  es¬ 
tablished  and  manned,  support  agree¬ 
ments  were  worked  out,  and  personnel 
have  been  trained.  The  AOTS  develop¬ 
ment  contract  was  awarded  1  August  85 
to  McDonnell  Douglas  Corporation,  ini¬ 
tiating  the  design  phase.  The  design 


Personnel  On-the-Job  Training 


A  fully  coordinated  and  signed  technol¬ 
ogy  transition  plan  is  available  for 


Aircraft  Maintenance  On-the-Job 
Training 


phase  was  completed  in  May  86,  and  the 
project  is  currently  in  the  development 
stage. 

AOTS  will  provide  the  Air  Force  with  a 
state-of-the-art  OJT  system  that  will 
meet  the  following  objectives:  define 


task  training  requirements  for  the 
operational  environment;  quality  con¬ 
trol  OJT  performance  evaluation;  sim¬ 
plify  OJT  administration;  automate 
training  management  and  evaluation; 
provide  a  training  management  informa¬ 
tion  system;  and  interface  OJT  with 
other  emerging  and  existing  computer 
systems . 

As  the  Air  Force  approaches  the  1990s, 
the  Air  Force  needs  to  improve  the 
methods  for  conducting  OJT.  New  weapon 
systems,  skills  compression  and  short¬ 
ages  of  skilled  technicians  all  indi¬ 
cate  a  greater  need  for  a  system  that 
is  automated  and  capable  of  handling 
the  Air  Force's  OJT  needs.  AOTS  is  the 
answer  to  this  challenge. 

Contact:  Maj  Jack  Blackhurst 
AFHRL/ ID-OLAK 

Bergstrom  AFB,  TX  78743-5000 
Commercial  (512)  479-2665 
AUTOVON  685-2665 
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MANPOWER  AND  PERSONNEL  DIVISION 


Selecting  the  most  qualified  applicants 
and  placing  them  in  the  right  jobs  are 
essential  to  maintaining  a  combat-ready 
Air  Force.  To  sustain  an  enlisted 
strength  of  over  488,000  and  an  officer 
corps  of  108,000,  the  Air  Force  must 
recruit  a  large  number  of  relatively 
untrained  individuals.  In  fact,  some 
65,000  new  airmen  are  brought  into  the 
Air  Force  each  year  and  matched  with 
jobs  in  245  career  fields.  To  keep  the 
officer  force  fully  manned  requires 
some  9,000  new  officers  yearly  for  jobs 
in  235  career  fields.  Matching  people 
and  jobs  continues  beyond  initial 
accession  since  each  year  over  10,000 
enlisted  members  change  career  fields. 


Colonel  Ronald  L.  Kerchner 
Division  Chief 


To  be  an  effective  fighting  force,  not 
only  must  the  newly  accessed  members 
be  trained  in  their  jobs,  but  also,  the 
entire  force  must  continue  to  train  to 
stay  proficient.  Each  year  125,000  en¬ 
listed  members  attend  formal  training 


and  many  more  participate  in  on-the-job 
training  to  retain  and  increase  job 
skills  and  abilities.  Initial  and  sub¬ 
sequent  training  of  officers  also  com¬ 
prises  a  significant  portion  of  officer 
force  management.  For  rated  officers 
alone,  1,600  new  pilots  and  750  new 
navigators  are  trained  each  year.  Of 
the  30,000  experienced  rated  officers, 
virtually  all  who  are  performing  flying 
duties  participate  in  some  form  of 
training  each  year.  Costs  of  this 
training  are  substantial.  For  example, 
training  an  FB-111  pilot  costs  over 
$1.3  million  and  the  navigator  training 
for  the  same  weapon  system  costs  over 
$700,000. 

Personnel  selection,  classification, 
and  training  are  all  part  of  a  force 
management  strategy  which  optimizes 
performance,  retention,  and  overall 
combat  readiness.  At  nearly  $20  bil¬ 
lion  yearly,  Air  Force  military  person¬ 
nel  costs  are  a  major  budget  item  re¬ 
quiring  effective  management  to  ensure 
the  Air  Force  gets  the  most  for  its 
investment . 


Dr.  William  E.  Alley 
Scientific  Advisor 


The  Manpower  and  Personnel  Division 
directs  a  comprehensive  and  long-term 
R&D  program  to  develop  the  tools,  pro¬ 
cedures,  and  associated  technologies 
to  ensure  more  effective  use  o.f  person¬ 
nel  resources.  Specific  R&D  programs 
are  organized  into  two  major  thrusts: 

1.  Personnel  qualification  testing 
which  includes  development  of  new  cog¬ 
nitive  tests  as  well  as  updating  of  the 
Armed  Services  Vocational  Aptitude  Bat¬ 
tery  (ASVAB)  and  Air  Force  Officer 
Qualifying  Test  (AFOQT). 

2.  Manpower,  personnel,  and  train¬ 
ing  integration  which  includes  Person- 
Job  Match  algorithms,  determination  of 
job  requirements  for  existing  and  fu¬ 
ture  weapon  systems,  and  manpower  fore¬ 
casting  technologies. 


Personnel  Qualification  Testing 

Learning  Abilities  Measurement  Program 
(LAMP) 

LAMP  is  a  major  research  effort  in 
ability  research  that  is  jointly  spon¬ 
sored  by  the  Air  Force  Office  of  Scien¬ 
tific  Research  (AFOSR)  and  AFKRL.  It 
utilizes  a  laboratory  at  Lackland  AFB 
which  houses  30  microcomputer-equipped 
testing  stations.  Approximately  300 
airmen  in  Basic  Military  Training  are 
available  as  subjects  each  week,  and 
over  40,000  have  participated  in  test¬ 
ing  conducted  to  date. 

There  are  two  major  objectives  for  the 
LAMP  effort:  first,  to  identify  the 
basic  components  of  human  cognition, 
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and  second,  to  determine  the  interac¬ 
tive  power  of  cognitive  components  in 
predicting  complex  learning  and  per¬ 
formance  behaviors.  The  AFOSR  has 
established  a  special  grant  program  to 
provide  support,  testing  facilities, 
and  Air  Force  subjects  to  university 
scientists  who  wish  to  help  us  in  our 
search  for  cognitive  components.  A  new 
laboratory  is  being  established  to 
support  the  second  goal  of  measuring 
learning  and  performance  behaviors. 

The  LAMP  effort  capitalizes  on  the 
availability  of  microcomputers  to  meas¬ 
ure  abilities  not  easily  evaluated 
with  paper-and-pencil  tests,  and  it 
leans  heavily  on  cognitive  science  to 
provide  a  theoretical  basis  for  the 
research  effort.  It  is  hypothesized 
that  individual  learning  and  perform¬ 
ance  can  be  accounted  for  by  knowl¬ 
edge,  processing  speed,  and  processing 
capacity  factors.  Much  of  the  research 
conducted  to  date  has  related  to  infor¬ 
mation  processing  speed  which  encom¬ 
passes  encoding,  comparing,  choosing, 
retrieving  from  memory,  memory  search¬ 
es,  and  attention  shifting.  Results 
indicate  that  measures  of  elementary 
processing  speed  are  not  likely  to  re¬ 
place  conventional  ability  tests,  but 
they  may  be  important  in  predicting  the 
performance  of  individuals  working  in 
high  information  flow  environments. 
Current  research  emphasis  is  on  infor¬ 
mation  processing  capacity,  with  an 
attempt  to  understand  its  role  in  ac¬ 
counting  for  memory  failures,  process¬ 
ing  errors,  and  information  overload. 

Although  this  program  is  devoted  to 
basic  research,  usable  outcomes  are 
anticipated.  For  example,  a  major  goal 
is  to  develop  new  ability  measures  for 
inclusion  in  future  personnel  selection 
and  classification  programs.  As  in  any 
basic  research  program,  however,  it 
will  be  a  number  of  years  before  the 
contribution  of  LAMP  is  fully  known. 
But  the  results  of  early  studies  and 
the  vision  of  ultimate  success  have 
already  generated  a  feeling  of  excite¬ 
ment  among  the  scientists  workirg  in 
the  program. 


Contact:  Dr.  Jeff  Kantor 
AFHRL/MOE 

Brooks  AFB ,  TX  782 35-560 1 
Commercial  (512)  536-3570 
AUTOVON  240-3570 


The  Air  Training  Command  1 ATC '  field 
test  of  the  AFHRL-de ve 1  oped  Pilot  an 
didate  Selection  Method  '  PCSMI  is  pr  > 
greasing  on  schedule.  The  PCSM  m 
bines  scores  from  the  AFOQT ,  grad*-* 
from  the  last  four  sortie*  if  r  hp 
Flight  Screening  Program  'PSP',  bio¬ 
graphical  information,  and  s< cores  from 
a  psychomotor  (eve-hand  <  oo rd i na f i on 
test  into  a  final  score  highly  predn 
t i ve  of  success  in  pilot  training.  The 
psycl  «otO'’  test  IS  given  bv  the  APHgi 


developed  Portable  Basle  Attributes 
Test  (PORT A- BAT)  ays tee.  Planning  with 
ATC  la  underway  to  establish  the  opera¬ 
tional  use  of  the  PCSM.  A  slightly 
eodlfled  version  of  the  PCSM  (without 
the  FSP  grades)  Is  being  considered  for 
use  by  the  Air  National  Guard  (ANG) 
for  selection  of  their  pilot  training 
candidates.  The  ANG  and  AFHRL  are 
working  towards  their  operational  use 
of  PCSM  starting  In  late  1986. 

The  PORTA-BAT  also  gives  a  battery  of 
Information  processing  and  personality 
tests  referred  to  as  the  Basic  Attri¬ 
butes  Test  (BAT).  The  BAT  and  PORTA- 
BAT  are  being  used  by  allied  air  forces 
In  two  asjor  International  RAD  pro¬ 
grams.  The  Royal  Australian  Air  Force 
began  a  cooperative  testing  program 
with  AFHRL  In  June  1986.  Two  PORTA-BAT 
systems  were  sent  to  Australia  and  will 
be  used  to  test  pilot  applicants,  heli¬ 
copter  pilots  from  the  Australian  Army 
and  Navy ,  end  combat  crew  members  from 
operational  squadrons.  The  goals  of 
this  program  are  to  independently  vali¬ 
date  the  BAT  as  a  screening/classifica¬ 
tion  instrument  for  pilot  selection  and 
claasif lcatlon,  examine  the  utility  of 
the  BAT  for  selecting  helicopter  pilots 
and  other  aircrew  positions,  and  sug¬ 
gest  possible  tests  or  improvements 
from  Australian  RAO  programs. 


A  second  International  RAO  program  Is 
being  conducted  as  part  of  AFHRL '■  sup¬ 
port  of  the  EURO-RATO  Aircrew  Selection 
Working  Croup.  In  this  program,  the 
PORTA-BAT  is  being  used  in  Germany, 
Great  Britain,  Denmark ,  the  Nether¬ 
lands  ,  Norway,  Belgium,  Italy,  and 
Portugal  as  part  of  aa  effort  to  im¬ 
prove  the  selection  of  fighter  pilots 
for  entry  into  the  EURO-NATO  Joint  Jet 
Pilot  Training  (ENJJPT)  program.  This 
project  is  designed  to  select  pilots 
who  will  succeed  la  becoming  "fighter 
pilots"  as  opposed  to  the  universally 
assignable  pilot  produced  by  the  USA/ 
Undergraduate  Pilot  Training  (UPT)  pro¬ 
gram.  The  ala  of  the  Working  Group  la 
to  Increase  the  success  rate  of  UJJP? 
candidates  and  establish  a  standard 


NATO  selection  system.  Each  partici¬ 
pating  nation  will  have  the  use  of 
PORTA-BAT  to  test  applicants  during 
some  portion  of  1986  and  1967.  Data 
will  be  shared  between  the  individual 
nations  and  AFHRL  who  will  analyse  the 
aggregate  performance  of  all  entrants 
in  a  combined  sample. 

Installation  of  a  fighter  pilot  per¬ 
formance  measurement  system  in  the  Air 
Combat  Maneuvering  Instrumentation 
(ACMI)  range  at  Luke  AFB  is  scheduled 
for  completion  in  late  1986.  Data 
gathered  from  "real -world"  airborne 
performance  on  the  range  will  help 
establiah  criteria  for  selection  into 
the  fighter  training  track  within  the 
Specialised  Undergraduate  Pilot  Train¬ 
ing  program.  A  related  project  to 
develop  pilot  performance  measures  for 
reconnaissance  mlaslons  is  sc  hedged 
to  begin  in  October  at  Bergstrom  AFB, 
Texas. 


Analysis  continues  of  the  performance 
of  USAF  ENJJPT  graduates  versus  USAF 
UPT  graduates  in  Lead-In  Fighter  Train¬ 
ing  (LIFT).  The  project  la  designed 
to  Investigate  the  effects  of  their 
different  training  syllabi  on  common 
performance  eleswnts  In  follow-on 
fighter  training  programs. 

Contact:  Dr.  Jeff  Kantor 
AFHRL/ HOE 

Brooks  AFB,  TX  78235-5*01 
Commercial  (512)  536-3570 
AITTOVOR  240-3570 
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The  ASVAB  is  used  as  the  primary  en¬ 
listment  selection  and  classification 
test  for  the  United  States  Armed  Ser¬ 
vices.  The  ASVAB  Is  administered  to 
approximate! y  one  million  applicants 
for  the  US  military  In  the  operational 
testing  program  as  null  as  smother  one 
million  high  school  students  In  the  DOD 
Student  Testing  Program.  The  Labora¬ 
tory  Is  the  lead  service  personnel  BAD 


organisation  supporting  the  joint  Serv¬ 
ice  and  DOD  prograas.  AFHRL  not  only 
develops  the  ASVABs  for  both  prograas, 
but  provides  RAD  work  necessary  to  sup¬ 
port  each  testing  systea.  This  year, 
AFHRL  completed  the  Initial  Operational 
Test  and  Evaluation  of  the  recently 
iapleaented  ASVAB  Foras  11,  12,  and  13. 
The  Laboratory  also  produced  final 
noraative  conversion  tables  for  these 
ASVABs  using  a  representative  saaple 
of  19S0  Aaerican  youth.  Deliberate 
failure  keys  were  also  developed  and 
given  to  the  US  Military  Enlistaent 
Processing  Command  (US  MEPCOM)  to  be 
used  to  detect  malingering  in  the  event 
of  national  aobi 1 icat ion. 

Development  and  publication  of  the 
ASVAB  Technical  Supplement  to  the 
Counselor’s  Manual was  accoap 1 i shed 
this  fiscal  year  in  support  of  the  DOD 
Student  Testing  Program.  Candidate 
follow-on  ASVAB  Foras  15,  16,  and  17 

were  constructed  and  tested  as  over¬ 
length  operational  tests  at  the  Serv¬ 
ices'  Recruit  Training  Centers.  The 
design  of  an  equating  effort  for  the 
operational  calibration  of  candidate 
ASVABs  was  coapleted  and  testing  began 
for  the  interim  calibration  of  the  new 
foras.  Hew,  over  length  ASVABs  were 
also  constructed  as  follow-on  foras  for 
ASVAB  14,  used  in  the  DOD  Student  Test¬ 


ing  Program.  Work  was  also  completed 
on  the  development  of  various  indices 
of  "appropriateness."  These  indices 
employed  state-of-the-art  psychometric 
advances  and  show  promise  for  use  in 
detecting  deliberate  failures  and  test 
compromise.  Work  was  also  completed 
on  a  project  to  determine  estimates  of 
the  alternate  forms  reliability  of  the 
ASVAB.  A  number  of  analytic  projects 
were  completed  for  the  Air  Staff. 
These  effort s  generally  examined  the 
projected  impact  of  the  new  normative 
conversion  tables  on  Air  Force  acces¬ 
sions.  The  Laboratory  also  revised  the 
Vocational  Interest  for  Career  Enhance¬ 
ment  Inventory  and,  in  conjunction  with 
the  Air  Force  Military  Personnel  Center 
and  US  MEPCOM,  designed  a  strategy  to 
try  out  this  interest  inventory  for  use 
in  refining  recruit  classification. 

Work  was  begun  on  a  project  to  examine 
the  effects  of  multidimensional  test 
items  on  the  estimation  of  test  itea 
parameters  in  computer-adainistered 
adaptive  tests.  The  Laboratory  also 
hosted  a  conference  to  provide  a  forum 
for  test  theorists  and  practitioners 
to  discuss  future  concepts  in  test 
validity. 

Contact:  Maj  John  Welsh 

AFHRL/MOA 

Brooks  AFB,  TX  78235-5601 

Coaaercial  (512)  536-3256 

AUTOVON  240-3256 


Air  Force  Officer  Qualifying  Test 

(afoqt)  1  * 

AFHRL  is  responsible  for  developing 
tests  used  in  officer  selection  and 
classification  decisions.  RAD  is  con¬ 
ducted  on  a  continuing  basis  to  uin- 
tain  and  improve  the  AFOQT,  which  is 
the  Air  Force’s  principal  aptitude  test 
for  officers.  A  major  project  underway 
has  the  objective  of  developing  a  large 
pool  of  new  test  items  for  use  in  sub¬ 
sequent  forms  of  the  AFOQT.  Items  have 
been  written  in  aptitude  areas  tested 
by  the  current  form  (Form  0).  Addi- 


Clonal  iteas  are  still  under  develop- 
aent.  Also,  icea  type  a  to  assess  new 
content  areas  are  being  identified,  and 
a  pool  of  iteas  will  be  developed  to 
cover  selected  new  content  areas  which 
aay  be  used  in  future  tests.  Nearly 
12,000  iteas  will  be  written  and  tried 
out  to  deteraine  their  acceptability 
for  use  in  operational  foras  of  the 
test. 

Two  new  versions  of  the  battery  will 
be  iapleaented  in  January  1987.  These 
two  versions  were  developed  froa  the 
early  iteas  produced  under  the  large- 
scale  itea  writing  effort.  In  order 
to  aeet  the  January  1987  lapleaentatlon 
deadline,  4,500  experimental  iteas  were 
pretested  at  Lackland  AFB.  The  pre¬ 
testing  resulted  in  two  proposed  paral¬ 
lel  versions  of  the  AFOQT.  These  two 
versions  were  then  adainistered  along 
with  the  current  fora  to  a  saaple  of 
602  Officer  Training  School  (0TS)  ca¬ 
dets,  2,027  Reserve  Officer  Training 
Corps  ( ROTC)  cadets,  and  781  basic 
trainees  to  ensure  all  three  tests  are 
parallel.  Careful  analyses  of  these 
data  are  In  progress  to  assure  that  the 
two  new  foras  (PI  and  P2)  are  properly 
equated  to  Fora  0. 

The  aajor  product  will  be  a  aore  up-to- 
date  AFOQT.  Production  of  parallel 
versions  will  reduce  the  possibility 
for  test  coaproalse  and  will  facilitate 
retesting  of  examinees  with  alternate 
foras.  New  itea  types  have  potential 
for  increasing  the  validity  of  the 
test.  In  recent  years,  AFOQT  test  re¬ 
sults  have  been  used  annually  in  a  pre¬ 
screening  process  to  identify  froa 
5,000  to  8,000  low-ability,  high-risk 
applicants  with  a  poor  probability  of 
success  in  officer  training  and  in  sub¬ 
sequent  career  assignaents.  Although 
the  dollar  savings  associated  with 
officer  aptitude  testing  are  indeter- 
alnate,  each  high-risk  applicant 
screened  out  represents  a  potential 
savings  of  $10,000  or  aore  in  coaals- 
slonlng  training  prograa  costs  alone. 


Work  is  continuing  in  the  development 
of  itea  pools  to  be  used  in  subsequent 
forms  of  the  AFOQT.  Support  materials 
for  AFOQT  Forms  PI  and  P2  have  been 
developed.  Validity  evaluations  are 
continuing  on  the  AFOQT;  analyses  are 
ongoing  using  the  AFOQT  subtests  to 
predict  aircrew  and  non-aircrew  crite¬ 
ria.  AFOQT  Quick  Scores,  which  are 
used  by  Air  Force  recruiters,  have  also 
been  evaluated.  Validation  of  the  0TS 
and  ROTC  selection  systems  is  nearing 
completion.  As  a  part  of  that  effort, 
0TS  student  graduate/ellminee  perform¬ 
ance  profiles  were  generated. 

Contact:  Dr.  Tom  Watson 

AFHRL/M0A0 

Brooks  AFB,  TX  78235-5601 

Commercial  (512)  536-2257 

AUTCVON  240-2257 

Testing  Program  Additional  Notes 

During  1986,  development  of  English 
Language  Tests  (both  elementary  and 
intermediate  versions)  was  completed, 
and  these  new  tests  were  implemented 
at  overseas  bases  for  use  in  selecting 
foreign  nationals  for  employment  at  the 
base.  These  new  versions  represent  a 
great  Improvement  over  their  predeces¬ 
sors. 

In  the  officer  test  area,  new  content 
areas  for  the  AFOQT  are  under  active 
investigation.  Ten  new  cognitive  item 
types  are  being  developed  for  valida¬ 
tion  and  evaluation  in  terms  of  contri¬ 
bution  to  the  existing  battery  content. 
In  addition,  plans  are  being  formulated 
for  careful  exploration  of  possible 
measures  of  leadership  and  management 
ability  as  contributors  to  effective 
officer  selection. 

A  number  of  efforts  exploring  various 
aspects  of  the  validity  of  the  ASVABs 
are  planned,  as  well  as  a  comparison 
of  the  ASVAB  to  the  General  Aptitude 
Test  Battery  (another  widely  used  mul¬ 
tiple  aptitude  battery).  The  Labora- 


tory  will  also  begin  developaent  of 
an  ASVAB  Archives.  The  Archives  will 
contain  all  published  and  unpublished 
aaterial  related  to  the  developaent  of 
the  joint-Service  and  student  testing 
programs,  as  well  as  all  extant  data 
sets  of  ASVAB  test  scores. 

We  continue  to  explore  Itea  Response 
Theory  (IRT)  and  possible  applications 
of  It  to  practical  probleas  in  opera¬ 
tional  testing  programs.  Methods  of 
detecting  deliberate  failure  on  the 


AFOQT  would  be  needed  In  the  event  of 
a  national  aobllixatlon.  Appropriate¬ 
ness  Indices  Bay  find  useful  applica¬ 
tion  in  the  detection  of  true  and 
deliberate  failures,  and  the  Laboratory 
is  sponsoring  the  operational  tryout 
of  aoae  of  these  Indices  in  the  near 
future.  Also  planned  for  future  devel¬ 
opaent  and  tryout  are  statistical  meth¬ 
ods  for  estiaation  of  frequencies  In 
censored  saaples — useful  in  no ruing 
and  validity  estiaation. 
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Slgnlflcant  aanpowcr  authorisation 
shortages  and  increasing  Industry  coa- 
petltlon  for  personnel  with  high  tech¬ 
nical  skills,  at  a  tlae  when  eaerglng 
weapon  systeaa  are  requiring  aore 
highly  skilled  personnel,  aandate  that 
MPT  requlreaents  be  evaluated  early  as 
part  of  new  weapon  systea  design  trade¬ 
off  decisions.  At  the  present  tine,  MPT 
requlreaents  have  little  lapact  on  de¬ 
sign  decisions.  If  these  MPT  requlre¬ 
aents  sre  to  lapact  design  decisions, 
they  aust  be  available  during  concept 
developaent  In  the  acquisition  process. 
There  Is  currently  no  adequate  technol¬ 
ogy  for  forecasting  MPT  requlreaents 
during  the  concept  developaent  stage. 


Further,  there  Is  no  technology  for 
Integrating  forecasted  requlreaents  for 
s  new  or  aodlfied  systea  with  other 
eaerglng  and  existing  systeas  to  fore¬ 
cast  total  force  lapact  and  assess  life 
cycle  MPT  supportablllty.  Another 
problea  is  that  fielding  of  new  or 
aodlfied  weapon  systeas  Is  suboptiaal 
because  the  acquisition  process  does 
not  provide  detailed  lnforaatlon  suf¬ 
ficiently  early  to  peralt  the  personnel 
and  training  pipelines  to  be  properly 
established  before  delivery.  This  de¬ 
lays  asslallatlon  of  the  new  weapon 
systeas  into  the  operational  force. 
There  is  elgnlflcant  evidence  of  this 
euboptlaal  fielding  of  new  weapon  sys¬ 
teas.  For  exaaple,  staffing  of  the  new 
systeas  usually  takes  sufficient  expe¬ 
rienced  personnel  froa  existing  weapon 
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systems  to  create  critical  experience 
shortages  in  the  existing  systems. 
Further,  in  the  early  years  after 
deployment,  extensive  changes  in  the 
new  weapon  system's  Air  Force  Specialty 
Codes  (AFSCs)  and  pipeline  training 
normally  occur,  creating  turbulence  in 
the  personnel  and  training  systems. 
Finally,  for  existing  weapon  systems 
there  are  insufficient  database  and 
software  mechanisms  for  MPT  managers 
to  consider  total  system  impact  when 
making  specific  decisions  in  their 
spheres  of  influence.  For  example, 
decisions  to  change  the  minimum  apti¬ 
tude  requireawnts  of  a  specialty  do  not 
fully  consider  associated  changes  in 
training  time  and  resource  require¬ 
ments.  Hence,  the  ability  of  the  train¬ 
ing  community  to  support  such  aptitude 
requirement  changes  has  not  been  fully 
considered  at  the  time  an  AFSC's  apti¬ 
tude  standards  are  changed.  In  addi¬ 
tion,  databases  and  models  are  not 
adequate  to  fully  consider  the  ability 
of  the  market  place  to  supply  recruits 
who  meet  the  new  standards  or  to  see 
if  raising  aptitude  standards  in  one 
AF8C  will  create  talent  voids  in  anoth¬ 
er  AF8C. 

The  MPT  Integration  Research  Project 
will  develop  technologies  to  solve  each 
of  the  problems  stated  above.  Specifi¬ 
cally,  weapon  system  acquisition  or 
modification  program  managers  will  be 
provided  procedures ,  databases ,  and 
software  necessary  (a)  to  sat  support¬ 
able  MPT  goals  for  an  emerging  weapon 
system,  (b)  to  forecast  the  MPT  re¬ 
quirements  associated  with  design  op¬ 
tions,  and  (c)  to  evaluate  the  total 
force  impact  of  the  selected  options. 
These  capebilities  should  ensure  that 
the  operational  systema  will  not  exceed 
MPT  supportability  constraints.  Also, 
detailed  task-level  information  will 
be  available  to  the  training  community 
for  input  into  the  Instructional  Sys- 
tems  Developsmnt  (ISO)  process,  and 
training  requirements  will  be  specified 
for  timely  insertion  into  the  budget 
process.  This  will  permit  development 
of  a  stable  and  effective  training 


pipeline  well  in  advance  of  weapon 
system  deployment.  In  addition,  the 
detailed  task-level  information  will 
permit  personnel  managers  to  establish 
efficient  specialty  structures,  set 
entry  standards,  establish  effective 
retraining  policies,  and  set  recruiting 
goals  well  before  deployment.  The 
training  and  personnel  managers'  in¬ 
volvement  in  supporting  the  new  weapon 
system  will  become  proactive  rather 
than  reactive  and  will  both  enhance 
deployment  and  shorten  the  time  between 
delivery  and  full  mission  capability. 
Finally,  integration  of  MPT  decision 
processes  for  existing  weapon  systema 
will  create  an  environment  where  MPT 
decisions  can  be  mutually  interactive, 
rather  than  isolated  decisions  which 
meet  one  manager's  needs  but  perhaps 
create  a  more  critical  problem  for 
another  manager. 


Although  the  MPT  integration  RAD  pro¬ 
ject  is  a  newly  identified  effort,  it 
involves  restructuring,  integrating, 
and  shifting  priorities  for  existing, 
ongoing  job  requirements  and  modeling 
RAD  efforts  rather  than  starting  total¬ 
ly  new  efforts.  Both  in-house  and  con¬ 
tract  RAD  will  be  used  to  develop  new 
MPT  forecasting  and  integrating  tech¬ 
nologies.  Specifically,  extensive  occu¬ 
pational  analysis,  task  benchmarking, 
aptitude  and  training  requirement  fore¬ 
casting,  and  job  and  force  modeling 
technologies  will  be  modified  or  devel¬ 
oped  to  fill  identified  technology 
gaps.  With  the  technologies  to  build 
databases,  new  forecasting  procedures 
will  feed  increasingly  larger  models 
until  the  ultimate  model,  Force  Impact 
Model,  is  complete.  Interim  products 
will  be  transitioned  to  MPT  users  for 
implementation  as  they  arc  completed. 
Technologies  now  nearing  completion 
will  aid  the  integration  of  MPT  deci¬ 
sions  for  existing  weapon  systaam.  RAD 
efforts  to  be  initiated  in  FT87  and 
FY88  will  be  directed  toward  enhancing 
the  fielding  of  new  weapon  systems. 
FY89  and  FYRO  RAD  initiatives  will  be 
directed  toward  developing  technologies 
for  forecasting  the  MPT  requirements  of 
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mw  weapon  lyitn  design  options  and 
providing  s  totsl  fores  view  of  MPT 
resources  and  constraints  to  deteraine 
supportabillty. 

Contsct:  Dr.  R.  Bruce  Gould 
AFHRL/MODS 

Brooks  AFB,  TX  78235-5601 
Coaaercial  (512)  536-3648 
AUTOVON  240-3648 


Civlllsn  sod  Military  Avallsblllty  RAD 

For  sons  years  there  has  been  s  growing 
coocern  aaong  allitary  MPT  planners 
that  not  enough  sttentlon  was  being 
given  to  MPT  issues  in  the  acquisition 
of  oew  wespon  systeas.  Succinctly 
stated,  the  problea  is  that  weapon 
systeas  are  being  planned  for  and  pro¬ 
cured  which  will  be  difficult  to  oper 
ate  and  aslntaln,  given  the  allitary 
services'  current  ability  to  attract 
and  retain  qualified  personnel.  This 
problea  is  of  key  concern  to  the  Air 
Force  ss  it  aoves  toward  the  use  of 
eweo  acre  technologically  advanced 
weapon  systeas.  Several  recent 
thrusts— aoat  notably  the  Navy's 
HARDMAN  project  end  Aray's  MAN PRINT 
project — have  atteapted  to  ensure  that 
proper  consideration  Is  given  to  MPT 
concerns  In  the  weapon  systeas 
acquisition  process. 

Om  of  the  key  parts  of  the  Air  Force's 
as  n  power  end  peraonMl -oriented  RAD 
progrea  in  this  area  will  be  the 
aatching  of  personnel  available  to 
operate  and  aslntaln  weapon  eyateas 
with  the  demand  for  euch  pereonnel. 
This  particular  RAD  progrea  will  focus 
on  developing  aodels  of  the  future 
availability  of  not  only  allitary  per- 
eonnel  but  civilian  personnel  as  well. 
Estlaetes  of  future  civilian  aental  and 
physical  qualifications  and  Interest 
In  eaterlng  allitary  service  are  re¬ 
quired  for  effective  MPT  planning. 

This  RAD  prog  ran  la  coaposed  of  two 
parts.  The  first  part  will  continue 


previous  AFHRL  work  in  nodellng  reten¬ 
tion  and  reenllstaent  decisions  by  Air 
Force  occupational  specialty.  The  Air 
Force  Reenllstaent  Analysis  Package 
(AFRAP)  will  be  enhanced  with  the 
inclusion  of  validated  reenllstaent 
estiaation  equations.  The  validation 
work  will  consist  of  using  reenllstaent 
estiaation  equations  developed  on  reen¬ 
llstaent  decisions  aade  through  1982 
to  predict  reenllstaent  decisions  aade 
since  that  tiae.  Where  necessary,  new 
equations,  by  AFS,  will  be  reestlaated 
end  included  in  the  AFRAP  software 
package.  This  package  peralts  the  user 
to  evaluate  the  iapact  on  reenllstaent 
rates  by  AFS  of  changes  In  econoalc  and 
deaographlc  factors  and  incorporate 
these  iapacts  on  a  length-of-service 
force  profile.  The  software  package 
is  designed  to  be  very  user-friendly 
and  operates  on  a  personal  coaputer. 
The  second  part  of  the  RAD  effort  Is 
the  design  of  a  civilian  availability 
aodel.  The  aodel  will  be  based  on  an 
extensive  analysis  of  existing  civilian 
availability  data  such  as  ASVAB  high 
school  testing  program  data,  data  on 
Individuals  interested  In  Air  Force 
service,  and  Bureau  of  Labor  Statistics 
and  Census  Bureau  population  projec¬ 
tions.  Particular  ewphasls  will  be 
given  to  determining  what  Air  Force 
Recruiting  Service  and  other  services 
do  to  estiMte  the  availability  and 
Interest  of  civilian  personnel  In  nill- 
tary  service.  Another  facet  of  this 
RAD  project  will  be  an  exawl  nation  of 
the  suitability  of  various  forecasting 
techniques  to  estlaate  the  long-range 
(5-15  year)  avsllablllty  of  civilians. 
This  tine  frane  Is  necessary  because 
of  the  length  of  tine  required  for 
weapon  systen  acquisition.  A  deaon- 
stratlon  aodel  will  be  designed  and 
tested  with  selected  data  and  forecast¬ 
ing  techniques. 

The  developaent  of  a  aodel  to  estlaate 
the  future  avsllablllty  of  allitary  and 
civilian  personnel  for  allitary  service 
will  be  of  greet  benefit  to  MPT  plan¬ 
ners.  The  ability  to  deteraine  where 


and  when  potential  future  shortfalls 
of  critical  personnel  can  happen  will 
be  of  significant  value.  Through  the 
use  of  a  civilian  availability  aodel 
and  a  military  retention  prediction 
aodel,  an  MPT  analyst  will  be  able  to 
estiaate  the  coapensation,  training 
and  other  policy  incentives  necessary 
to  attract  sufficient  nuabers  and 
types  of  nonprior-service  personnel  to 
join  the  Air  Force,  as  well  as  to 
retain  current  ective  duty  individuals 
in  key  ailitary  jobs  and/or  those 
individuals  capable  of  being  retrained 
to  operate  and  amintain  new  weapon 
systesu . 


Work  is  underway  to  validate  the  esti¬ 
mating  equations  in  the  AFRAP  soft¬ 
ware.  The  model  will  be  enhanced  with 
the  revalidated  equations  along  with 
several  changes  suggested  by  interested 
potential  users.  The  civilian  avail¬ 
ability  RAD  effort  is  scheduled  to 
begin  in  early  FY87.  Both  should  be 
completed  by  the  end  of  calendar  year 
1987. 

Contact:  Mr.  Larry  T.  Looper 
AFHRL/MOMD 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-3942 
AUT0V0N  240-3942 


OCCUPATIONAL  MEASUREMENT  TECHNOLOGY 


The  principal  occupational  analysis 
technology  in  the  Air  Force  is  the 
Comprehensive  Occupationel  Dots  Analy¬ 
sis  Programs  (CODA?)  software  system, 
which  has  supported  a  major  occupa¬ 
tional  RAO  program  within  the  Labor¬ 
atory  and  a  major  operational  analysis 
program  within  the  Air  Force  Occupa¬ 


tional  Measurement  Center  (AFOMC)  since 
1967.  CODA? -genera ted  products  have 
had  significant  inpacts  on  the  develop¬ 
ment  of  Air  Force  technical  training, 
in  t'le  evaluation  and  revision  of  Air 
Force  enlisted  classification  struc¬ 
tures,  and  in  the  establishment  of  s 
scientifically  sound  basis  for  realign¬ 
ing  entry-level  aptitude  requirements 
across  Air  Force  enlisted  career 
fields.  Over  the  last  15  years,  the 


CO  DAP  systea  has  grown  in  size  and  com¬ 
plexity  as  a  direct  result  of  signifi¬ 
cant  hardware  improvements  to  the  AFHRL 
Sperry  System  and  due  to  major  enhance¬ 
ments  to  the  basic  structure  of  the 
CODAP  software  itself. 

Increasing  sophistication  in  the  meth¬ 
ods  and  procedures  required  by  Air 
Force  occupational  researchers  and 
analysts,  and  a  wider  range  of  users 
and  applications,  forced  the  somewhat 
unsystematic  expansion  of  the  system. 
Over  time,  the  programs  became  dif¬ 
ficult  to  maintain,  modify,  or  augment 
without  extensive  programmer  training 
and  experience.  It  became  increasingly 
urgent  that  a  major  systea  redesign 
effort  be  launched  to  consolidate  and 
use  to  better  advantage  the  many 
additions  and  modifications  that  had 
been  incorporated  into  CODAP  over  the 
years  and  to  create  new  technology  and 
software  to  meet  the  current  and  antic¬ 
ipated  methodological  and  applications 
requirements  of  CODAP  users. 

The  products  of  the  redesign  effort 
will  provide  CO DAP  programmers  and  com¬ 
puter  technicians  with  software  that 
is  easier  to  execute,  maintain,  and 
modify.  Occupational  analysts  will  have 
available  more  effective  analytic  tools 
for  performing  Job  analysis  in  opera¬ 
tional  settings,  and  occupational 
researchers  will  be  provided  with 
state-of-the-art  RAD  tools  necessary 
for  addressing  their  ongoing  and  future 
occupational  measurement  needs.  Other 
users  such  as  industry,  academia, 
allied  forces.  Army,  Navy,  and  various 
Government  users  who  have  adopted  CODAP 
will  now  find  it  much  easier  to  incor¬ 
porate  software  updates. 

The  goal  of  this  multiyear  project  is 
to  develop  a  prototypal  occupational 
measurement  software  system  which  will 
lmtegrate  historical  changes  to  the 
CO DAP  system  with  newly  developed  capa¬ 
bilities.  ly  the  end  of  FY8B,  three 
major  project  objectives  had  been 
achieved.  First,  operational  efficien¬ 
cy  of  the  system  has  been  Increased. 


Fewer  runs  are  now  required  to  accom¬ 
plish  a  standard  analysis,  and  run  set¬ 
ups  have  been  simplified.  The  develop¬ 
ment  of  a  computer-based  training  pack¬ 
age,  along  with  better  internal  and 
supporting  documentation,  enables  tech¬ 
nicians  to  learn  the  system  faster  and 
with  less  supervision.  Redundant  pro¬ 
grams  have  been  eliminated,  and  core 
requirements  for  many  programs  have 
been  reduced,  resulting  in  much  faster 
turnaround  times.  Second,  system  main¬ 
tainability  has  been  improved.  Consis¬ 
tent  documentation  throughout  the  sys¬ 
tem  permits  programmers  and  programming 
technicians  to  operate  and  debug  the 
systea  without  excessive  expenditure 
of  time  and  money.  Formalized  test  and 
acceptance  procedures  ensure  that  the 
new  and  modified  software  is  working 
properly  for  all  types  of  CODAF  data 
sets.  Finally,  analytic  capabilities 
of  the  systea  have  been  expanded.  The 
improved  American  Standard  Code  for  In¬ 
formation  Interchange  (ASCII)  Fortran 
version  of  the  CODAP  system  accepts  up 
to  20,000  cases,  3,000  task  items  per 
case,  and  2,000  background  variables. 
Hierarchical  clustering  can  be  perform¬ 
ed  on  7,000  cases  or  3,000  tasks.  Along 
with  increased  system  limits,  new  capa¬ 
bilities  have  been  explored  including 
the  areas  of  profile  analysis,  nonhler- 
archical  clustering,  two-way  clustering 
(cases  x  tasks),  module  technology,  and 
automated  job  typing.  Final  products 
are  more  readable,  and  users  are  given 
greater  flexibility  in  their  use  of 
free  text  and  in  formatting  reports. 
Non-CO DAP  software  (correlation  and 
regression,  factor  analysis,  statisti¬ 
cal  packages  such  as  Statistical  Pack¬ 
age  for  the  Social  Sciences  (SPSS)  and 
Biomedical  Program  (BMDP))  are  now 
accessible  through  interfaces  with  the 
AFHRL  Sperry. 

Like  its  predecessor,  ASCII  CODAP  will 
continue  to  support  AFOHC’s  occupa¬ 
tional  analysis  program  in  establishing 
classification  and  training  criteria 
for  the  Air  Force.  Major  new  Air 
Force  MPT  programs  which  will  re¬ 
quire  use  of  occupational  survey  data 


will  benefit  from  the  system's  advanced 
capabilities  as  will  Air  Force  opera¬ 
tional  managers  and  decision  makers. 
An  example  of  such  an  operational  ap¬ 
plication  would  be  in  the  use  of  CODAP- 
based  occupational  survey  data  to  help 
establish  test  outline  "testing  impor¬ 
tance"  specifications  for  the  develop¬ 
ment  of  enlisted  promotion  tests. 

As  in  recent  years,  the  new  system  will 
be  made  available  for  transfer  to  other 
US  Armed  Services  and  to  our  allied 
military  services;  to  Federal  and  state 
agencies,  county-level  governments,  and 
universities;  and  to  commercial  and 
industrial  firms.  AFHRL  currently  is 
involved  with  the  personnel  department 
of  the  city  of  Fort  Worth,  Texas,  which 
is  analyzing  occupational  data  on  cler¬ 
ical  workers  to  evaluate  the  adequacy 
of  their  present  job  classification 
structure,  to  develop  job  descriptions, 
and  to  assess  training  needs  in  their 
clerical  occupations. 

In  the  next  year,  we  will  continue  to 
upgrade  the  computer-based  training 
course,  not  only  for  ASCII  COOAP  tech¬ 
nicians  but  for  programmers  and  ana¬ 
lysts  as  well.  Advanced  development 
and  operational  testing  of  the  new 
CODAP  system  will  go  on,  as  will  explo¬ 
ration  of  new,  more  sophisticated  ana¬ 
lytic  techniques  such  as  semantic 
analysis,  nonhierarchical  clustering 
and  automated  job-type  selection. 
Transition  of  the  new  system  to  the 
Occupational  Measurement  Center  will 
progress,  with  a  fully  operational 
system  expected  by  early  1988. 

Contact:  Mr.  William  J.  Phalen 

2d  Lt  Kathleen  M.  Longmire 
AFHRL/MOD 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-3551 
AUTOVOH  240-3551 


lecruiting  and  Technical  Training 

Impact  Models 

Effective  personnel  and  training  man- 
agement  requires  knowledge  of  the  im¬ 


pact  of  adjustments  in  a  bewildering 
array  of  factors.  Although  experienced 
managers  can  estimate  the  probable  im¬ 
pact  of  adjustments  in  a  single  factor, 
it  is  nearly  impossible  to  accurately 
estimate  the  impact  of  simultaneous 
adjustments  in  several  factors.  Com¬ 
puterized  decision  aids  can  easily 
accommodate  the  complexity  of  multiple 
factors  and  provide  a  means  of  evaluat¬ 
ing  management  alternatives  prior  to 
final  decision  and  implementation. 
Dual  forecasting  systems,  known  as  the 
Recruiting  Impact  Model  (RIM)  and  the 
Technical  Training  Impact  Model  (TTIM), 
are  under  development  to  provide  tools 
for  personnel  and  training  management. 
These  tools  are  designed  to  provide 
estimates  of  recruiting  and  training 
outcomes  likely  to  result  from  proposed 
management  actions.  For  example,  a 
proposed  aptitude  requirement  minimum 
for  a  given  job  specialty  would  be 
evaluated  on  the  basis  of  projected 
recruiting  shortfalls,  given  the  con¬ 
straint  on  recruiting  imposed  by  the 
aptitude  requirement.  Also,  the  pro¬ 
posed  aptitude  requirement  would  be 
evaluated  on  the  basis  of  the  variable 
training  costs  that  are  projected  as 
necessary  to  produce  skilled  techni¬ 
cians.  If  unacceptable  recruiting  or 
training  outcomes  were  projected  for 
the  proposed  aptitude  requirement  min¬ 
imum,  alternatives  could  be  evaluated 
by  way  of  an  iterative  planning  loop. 
More  effective  management  of  recruiting 
and  training  resources  would  issue  from 
the  use  of  computerized  decision  aids 
which  allow  anticipation  and  avoidance 
of  adverse  recruiting  and  training  out¬ 
comes. 

The  R&D  consists  of  the  development  of 
two  computer  models  which  will  operate 
sequentially  to  simulate  the  personnel 
and  training  pipeline.  For  the 
Recruiting  Impact  Model,  RAD  consists 
of  the  development  of  a  computer  pro¬ 
gram  which  can  be  used  to  project,  on 
a  specialty-by-specialty  basis,  re¬ 
cruiting  shortfalls  and  the  aptitude 
distribution  of  assigned  personnel. 
For  each  job  specialty,  the  estimated 
aptitude  distribution  would  be  combined 
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with  other  personnel  attributes  and 
several  course  factors  to  form  the 
Input  for  the  TTIM.  Training  impact 
R&D  consists  of  the  development  of  a 
covariance  structure  model  of  initial 
skills  training  and  involves  specifica¬ 
tion  of  the  magnitude  of  the  effects 
of  student  and  course  factors  on  train¬ 
ing  outcomes  such  as  number  of  remedi¬ 
ation  houis,  student  elimination  rates, 
and  variable  training  costs. 


A  computer  program  designed  to  project 
recruiting  outcomes  is  nearing  comple¬ 
tion.  Regression  equations  designed 
to  forecast  technical  training  outcomes 
have  been  developed  and  are  being  val¬ 
idated.  Work  in  support  of  the  devel¬ 
opment  of  the  computer  program  for  the 
TTIM  has  commenced.  The  RIM  and  TTIM 
should  be  available  for  operational 
use  by  the  end  of  FY87. 


Contact : 


Dr.  Joe  L.  Weeks 
AFHRL/MOD 

Brooks  APB,  TX  78235-5601 
Commercial  (512)  536-3551 
AUTOVON  240-3551 


Expansion  of  Person-Job  Match  Tech¬ 
nology  ~ 


The  Procurement  Management  Information 
System  (PROMIS)  selects  and  classifies 
noBprior-servlce  enlisted  personnel 


into  specific  Air  Force  Specialties 
(AFSs)  or  into  an  Air  Force  aptitude 
area  (Mechanical  (M) ,  Administrative 
(A),  General  (G),  or  Electronics  (E)). 
Personnel  classified  into  an  area  are 
called  Aptitude  Index  (AI)  enlistments. 
The  Processing  and  Classification  of 
Enlistees  (PACE)  system  classifies  the 
AI  personnel  classified  by  PROMIS  into 
specific  AFSs  during  basic  training. 
In  the  retraining  area,  over  10,000 
airmen  are  selected  each  year  for 
training  into  new  specialties.  Deci¬ 
sions  as  to  which  specialties  they 
enter  are  based  on  a  first-in,  first- 
approved  procedure,  with  little  regard 
to  selecting  the  better-qualified  ap¬ 
plicants.  This  procedure  contributes 
to  non-optimal  reclassification  of  air¬ 
men  for  retraining.  This  could  lead 
to  higher  attrition  from  technical 
training  and  to  lower  job  satisfaction 
for  those  who  begin  working  in  the  new 
fields.  The  R&D  efforts  in  support  of 
PROMIS,  PACE,  and  retraining  are  de¬ 
signed  to  improve  the  selection  and 
classification  of  airmen  at  different 
points  in  their  careers.  These  R&D 
efforts  will  improve  the  personnel  sys¬ 
tems  by  using  state-of-the-art  assign¬ 
ment  algorithms  and  the  latest  results 
of  personnel  R&D.  Since  the  PROMIS , 
PACE,  and  retraining  systems  efforts 
are  at  different  stages  in  their  devel¬ 
opment,  they  will  be  addressed  as  sep¬ 
arate  but  similar  efforts. 
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CLASSIFICATION  OF  AIR  FORCE  NONPRIOR  SERVICE 
AND  RETRAINING  PERSONNEL 
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PROMIS  was  developed  in  1975/76  and 
took  advantage  of  the  classification 
and  personnel  R&D  of  that  time.  PROMIS 
is  a  classification  algorithm  that 
assigns  personnel  sequentially  (one 
person  at  a  time)  based  on  the  "worth 
or  payoff"  of  that  person  in  an  AFS 
combined  with  the  prediction  of  future 
accessions  for  the  AFS.  The  R&D 
efforts  to  enhance  PROMIS  that  will  be 
started  or  completed  in  FY86  and  FY87 
are:  (a)  to  include  additional  infor¬ 

mation  to  use  in  evaluating  the  worth 
of  a  person  on  a  job,  (b)  to  consider 
alternative  sequential  classification 
algorithms,  (c)  to  include  the  Voca¬ 
tional  Interest  for  Career  Enhancement 
inventory,  (d)  to  implement  improved 
regression  equations  to  predict  tech¬ 
nical  school  success,  and  (e)  to  con¬ 
sider  new  methods  to  predict  future 
accessions. 

The  present  PACE  classification  system 
does  not  take  advantage  of  personnel 
R&D  results  or  mathematical  algorithms 
to  make  its  classi f icat ions .  R&D  in 
progress  will  upgrade  PACE  so  that  it 
will  take  advantage  of  past  Person-Job 
Match  (PJM)  R&D  and  will  use  state-of- 
the-art  linear  programming  techniques. 
R&D  initiated  in  September  1985  devel¬ 
oped  a  PACE  classification  policy.  As 
in  PROMIS,  the  policy  will  be  used  to 
compute  the  worth  of  classifying  a 


ASSOWENTS 


person  to  an  AFS.  PACE  R&D  efforts  to 
be  started  or  completed  in  FY86  and 
FY87  are:  (a)  development  of  the  PACE 
classification  policy,  (b)  implementa¬ 
tion  of  algorithms  to  optimally  clas¬ 
sify  personnel,  (c)  designing  of  data 
files  needed  by  the  PACE  operational 
prototype,  (d)  development  of  the  PACE 
prototype,  (e)  testing  and  evaluation 
of  the  prototype  by  running  both  the 
existing  and  new  PACE  classification 
systems  in  parallel,  and  (f)  delivery 
of  the  prototype  and  policy-generating 
programs  to  Air  Training  Command  for 
operational  use. 

The  primary  objective  of  the  current 
retraining  classification  R&D  is  to 
develop  a  methodology  that  will  opti¬ 
mally  reclassify  enlisted  personnel  for 
retraining  according  to  a  predefined 
Air  Force  policy.  The  new  retraining 
system  will  utilize  PJM  selection  and 
classification  methodology  already  de¬ 
veloped  in  the  PROMIS  and  PACE  systems. 
Usable  variables  from  PROMIS  and  PACE 
and  new  variables  will  be  integrated 
into  the  retraining  system.  A  working 
group  composed  of  retraining  program 
managers  and  AFHRL  scientists  first 
met  in  May  1986.  The  group  will  iden¬ 
tify  variables  and  develop  a  retraining 
policy  using  policy-specifying  tech¬ 
niques.  System  development  will  in¬ 
clude  the  definition  of  an  algorithm 


Co  optimally  assign  personnel  based  on 
Air  Force  requirements  and  available 
talent.  The  retraining  policy  is  ex¬ 
pected  to  be  completed  by  January  1987. 
A  prototype  will  then  be  developed  for 
small-scale  testing.  In  addition  to 
making  optimal  retraining  assignments, 
the  new  retraining  system  will  sake 
work  easier  for  system  managers.  There 
will  be  fewer  requirements  for  waiver 
determination,  quicker  and  more  accu¬ 
rate  decisions  on  applications,  and 
reduced  requireaents  for  selective 
retraining  of  nonvolunteers. 

The  outcome  of  this  RAD  effort  will 
result  in  three  systems  which  will 
classify  personnel  in  a  similar  and 
optiael  manner.  By  using  AFHRL  person¬ 
nel  BAD  results  and  operationa  BAD 
techniques,  classifications  should  re¬ 
sult  in:  (a)  the  meeting  of  P10HIS, 
PACE,  and  retraining  classification 
goals;  (b)  increased  retention;  (c) 
less  attrition  cost;  (d)  less  cost  due 
to  casual  time  (the  waiting  time  be¬ 
tween  graduation  from  basic  military 
training  and  beginning  of  technical 
school);  Ce)  improved  switching  of  abil¬ 
ities  with  the  difficulty  of  the  AFS; 
(f)  increased  job  satisfaction  and  mo¬ 
tivation  through  considering  personal 
interests;  and  (g)  improved  success  in 
the  Air  Force. 

Contact:  Dr.  Manuel  Pina,  Jr. 

Capt  Mark  Emerson 

APMBL/MOM 

Brooks  AFB,  TX  78235-5601 

Commercial  (512)  536-3942 

A17TOVOII  240-3942 


Beaic  Job  Skills  Beseatch  Proa ram 

Modem  Air  Force  work  centers  reflect 
the  technological  advances  that  have 
established  the  Air  Force  as  a  "tech¬ 
nological  pacesetter"  in  today's  world. 
That  role  carries  with  it  the  need  to 
define  the  intellectual  demands  that 
complex  systems  levy  on  workers  so  that 
training  can  be  advanced  to  keep  pare 


with  rapidly  developing  hardware  tech¬ 
nologies.  In  response  to  this  need,  a 
large-scale  RAD  effort — the  Basic  Job 
Skills  (BJS)  Research  Program — has  been 
initiated.  The  overall  goal  is  two¬ 
fold:  (a)  to  examine  125  Air  Force 
occupations  in  order  to  define  high- 
tech  competence  in  terms  of  the  skills 
that  are  shared  across  domains  (basic 
job  skills),  and  (b)  to  develop  adapt¬ 
ive  training  based  on  the  skill  common¬ 
alities.  Basic  job  skills  are  defined 
as  the  core  knowledge  and  thinking  pro¬ 
cesses;  that  is,  the  unobservable 
amntal  events  that  underlie  expert  per¬ 
formance  on  the  Air  Force's  most  tech¬ 
nically  deawinding  tasks.  They  can  be 
considered  the  components  of  scientific 
literacy  needed  for  performance  in 
today's  high-tech  work  environments . 
For  example,  a  technician's  "mental 
model"  or  internal ixed  conception  of 
how  an  automated  electronic  test 
station  works  is  considered  a  basic 
job  skill. 

Precise  definitions  of  shared  skills 
such  as  these  can  produce  answers  to 
questions  about  the  optisml  knowledge 
humans  should  have  in  work  centers 
saturated  by  "smart  machines.”  Further, 
the  focus  on  the  unobservable  mental 
events  that  account  for  technical  ex¬ 
pertise  makes  it  possible  to  accurately 
represent  and  train  the  skills  that  are 
demanded  in  the  high  information  flow 
environments  created  by  complex  tech¬ 
nological  systems.  Training  will  be 
able  to  focus  on  the  thinking  required 
for  modem  Air  Force  work  centers,  with 
the  goal  of  fostering  in  apprentices 
"performance  with  understanding."  Pay¬ 
offs  will  also  be  derived  from  central¬ 
ising  the  instruction  for  thousands  of 
apprentices  m  a  streamlined  and  potent 
instructional  system  that  takes  advan 
tage  of  AFS  commonalities. 

A  three-stage  RAD  approach  has  been 
implemented  to  produce  task  analysis, 
diagnostic  test,  and  training  outcomes. 
First,  cognitive  task  analysts  methods 
to  capture  the  unobee r v a h : e  mental 


•vents  of  technical  expertise  have  been 
developed  and  tested  in  five  Air  Force 
occupations.  The  events  are  analyzed 
for  content  and  process  siailarities 
and  then  fed  into  the  second  R&D  stage. 
At  this  stage,  problea-orlented  tests 
are  developed  to  diagnose  trainees' 
deficits  in  the  skill  areas.  In  the 
third  stage,  results  froa  cognitive 
analyses  provide  the  basis  for  a  series 
of  pro bleu -oriented  training  systeas 
designed  to  cover  aore  and  aore  skills 
and  occupations.  The  initial  instruc¬ 
tional  systeas  will  present  trainees 
simulated  troubleshooting  environaents 
(intelligent  practice  environaents) 
using  intelligent  tutor  coaputer  sys¬ 
teas.  The  tutors  provide  support,  ad¬ 
vice,  and  criticise  as  trainees  prac¬ 
tice  asking  diagnoses  of  increasingly 
coaplex  systeas. 

The  following  aajor  accoapllshaents 
highlighted  the  BJS  Prograa  in  FY86: 

1.  Field-test  stage  of  the  application 
of  cognitive  task  analysis  wet hods  to 
125  AFSs  was  coapleted. 

Workshops  were  held  at  three  oper¬ 
ational  sites  (Langley  AFB,  VA; 
Cheyenne  Mt .  Coaplex,  CO;  and  Nellis 
AF1,  NV).  Over  20  Air  Force  technical 
experts  and  20  apprentice  alraen  par¬ 
ticipated  In  each  10-day  workshop 
event . 

Prototype  task  analysis  net  hods 
were  developed  based  on  workshop  expe¬ 
riences  . 

2.  Large-scale  testing  of  a  pervasive 
basic  Job  skill  Identified  during  FY84 
feasibility  work  (l.e.,  the  skill  of 
determining  logic  gate  input /output 
values  in  tracing  digits'  circuitry  in 
electronics)  was  accomplished  on  119 
alraen  In  three  organisations  at  Nellis 
Aft,  NV. 

Design  specifications  were  coaplet¬ 
ed  for  the  first  training  systea  to  be 
developed  as  part  of  this  RAD  prograa. 
Aa  Intelligent  tutoring  systea  deliver¬ 


ing  30  to  50  hours  of  instruction  to 
Integrated  avionics  technicians  has 
been  designed  as  a  demonstration  train¬ 
er  for  this  effort. 

Contact:  Dr.  Sherrie  P.  Gott 
AFHRL/MOD 

Brooks  AFB,  TX  78235-5601 
Commercial  (512)  536-3648 
AUT0V0N  240-3648 


Value  of  Air  Force  Experience 

In  this  period  of  Increased  emphasis 
on  reducing  costs  and  accomplishing  the 
defense  mission  with  fewer  resources, 
the  Air  Force  is  often  required  to 
address  the  impact  of  different  compen¬ 
sation  and  policy  alternatives  on  the 
coaposition  and  experience  mix  of  the 
enlisted  and  officer  forces.  Cost  com¬ 
parisons  must  be  made  between  having  a 
more  experienced  but  more  costly  force 
and  a  less  experienced  but  less  costly 
force.  Closely  associated  with  this 
problem  is  the  demand  placed  on  the  Air 
Force  to  answer  DOD  and  Congressional 
inquiries  about  the  impact  of  losing 
experienced  personnel  and  the  cost  of 
replacing  such  individuals  in  critical 
job  specialties.  Air  Force  manpower 
and  personnel  planners  need  a  logically 
defensible  and  scientifically  sound 
method  to  be  able  to  respond  to  these 
questions.  Such  a  methodology  will 
enable  the  Air  Staff  user  to  quantify 
in  dollar  terms  the  value  of  Air  Force 
job  experience,  training,  length  of 
service,  and  other  key  variables  across 
critical  enlisted  and  officer  special¬ 
ties,  occupational  and  demographic 
groupings,  and  the  total  force. 

This  R&D  will  center  on  providing  new 
and  creative  solutions  to  the  problem 
of  costing  (valuing)  Air  Force  expe¬ 
rience.  It  will  not  be  limited  solely 
to  determining  replacement  costs  or 
training  costs,  but  will  result  in  a 
model  that  reflects  the  entire  life 
cycle  and  future  worth  of  experienced 
personnel  in  critical  Air  Force  occupa¬ 
tions.  The  work  will  consist  of  three 


phases.  Phase  1  will  see  an  extensive 
review  of  relevant  human  resource 
accounting  and  human  capital  models  and 
previous  work.  The  goal  in  this  phase 
is  to  integrate  the  various  approaches 
where  possible  and  to  suggest  areas 
where  new  technological  break-throughs 
need  to  be  made.  Primary  emphasis  will 
be  on  tailoring  the  techniques  or 
devising  modifications  to  existing 
approaches  which  will  make  them  suit¬ 
able  for  the  unique  characteristics  of 
the  Air  Force  and  military  environment. 
Phase  2  will  select  one  of  the  ap¬ 
proaches,  a  modified  approach  or  new 
concept  from  Phase  1,  and  develop  a 
design  for  a  model  of  the  value  of  Air 
Force  experience.  Phase  3  will  develop 
the  model  to  the  extent  that  an  opera¬ 
tional  evaluation  of  the  model  using 
actual  Air  Force  occupations,  training 
types,  and  service  groups  can  be  made. 

The  primary  benefit  of  this  R&D  will 
be  to  provide  Air  Force  manpower  and 
personnel  planners  and  managers  with 
an  analytical  tool  to  assess  the  value 
of  Air  Force  experience.  The  support¬ 
ing  methodology  will  aid  in  establish¬ 
ing  the  relative  value  of  different 
kinds  of  Air  Force  personnel  and, 
thereby,  help  determine  the  cost  of 
losing  and  replacing  such  experienced 
airmen  or  officers.  Better-informed 
decisions  on  force  structure  and  force 
management  should  help  the  Air  Force 
to  accomplish  Its  defense  goals  within 
the  stringent  boundaries  of  limited 
fiscal  sod  personnel  resources.  As 
x  he  era  of  dwindling  manpower  pools 
approaches ,  knowing  the  cost  tradeoffs 
o*'essarv  to  obtain  or  retain  certain 
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but  knowing  just  how  expensive  can  aid 
in  fashioning  cost-effective  force 
structure  and  retention  policies. 

At  the  end  of  FY86,  this  project  will 
be  In  the  early  stages  of  contract  pro¬ 
curement.  A  Program  Research  4  Devel¬ 
opment  Announcement  (PRM)  was  selected 
as  the  avenue  for  soliciting  proposals. 
Two  firms  have  been  identified  for  con¬ 
tract  award  and  purchase  requests  are 
being  prepared.  Under  the  PRDA  arrange¬ 
ment,  these  two  firms  will  each  provide 
new  and  creative  solutions  to  the  prob¬ 
lem  but  each  will  suggest  a  different 
approach.  Once  the  18-month  efforts 
are  completed  (scheduled  for  January 
1987  starts),  AFHRL  will  select  one  of 
the  approaches  for  further  development. 

Contact:  Larry  T.  Looper 
AFHRL/MOMD 

Brooks  AFB,  TX  78235-5601 
Commerical  (512)  536-3942 
AUTOVON  240-3942 


Reevaluation  of  the  Weighted  Airman 
Promotion  System  (WAPS)  ~~ 

Each  year  the  Air  Force  promotes  ap¬ 
proximately  45,000  airmen  to  the  grades 
of  staff  sergeant  (E-5),  technical  ser¬ 
geant  (E-6),  and  master  sergeant  (E-7) 
from  a  pool  of  over  240,000  eligibles. 

The  enlisted  promotion  system  used  to 
select  these  promotees  is  the  WAPS. 

Basic  components  of  WAPS  consist  of  six 
promotion  selection  factors  and  cor¬ 
responding  weights  that  are  used  to 
compute  a  total  weighted  factors  pro¬ 
motion  score  for  each  airman  considered 
for  promotion.  The  six  selection  fac¬ 
tors  involve  two  test  scores,  two  se¬ 
niority  measures,  decorations,  anc  job 
performance  ratings.  For  each  gvade, 
eligible  airmen  within  each  AFS  are 
aligned  in  ordjr  by  their  total 
weighted  factors  score.  A  promotion  i 

quota  Is  then  applied,  and  those  airmen 
with  the  highest  scores  in  each  AFS  are 
promoted.  The  system  has  been  fully 
o 'erational  since  1970;  however,  to  ( 
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keep  WAPS  running  saoothly  and  up  to 
date,  It  aust  be  periodically  reeval¬ 
uated. 

Working  in  close  coordination  with  the 
Military  Personnel  Center  and  the  Air 
Staff,  the  Manpower  and  Personnel  Divi¬ 
sion  initiated  a  project  in  1985  to  re¬ 
evaluate  the  current  WAPS.  The  sain 
objective  was  to  coapare  a  newly  devel¬ 
oped  weighted  foraula  for  each  grade 
with  the  operational  systea  to  identify 
significant  changes,  if  any.  Other 
objectives  addressed  included  the  fol¬ 
lowing:  (a)  determine  if  separate 

weighted  formulas  are  required  for  each 
of  the  three  grades,  (b)  consider  the 
completion  of  Command  Noncommissioned 
Officer  Academy  as  an  additional  selec¬ 
tion  factor  for  promotion  to  E-7,  (c) 
evaluate  various  weighting  strategies 
for  the  Airman  Performance  Report  (APR) 
factor,  (d)  investigate  the  use  of 
standardized  scores  for  the  test  fac¬ 
tors,  and  (e)  analyze  the  establishment 
of  a  separate  weighted  formula  for 
those  AFSs  which  have  no  Specialty 
Knowledge  Test  (SKT).  In  June  1985,  a 
carefully  selected  group  of  six  colo¬ 
nels  and  six  chief  master  sergeants 
convened  at  AFHRL  to  form  an  experi¬ 


mental  promotion  polity  boer<i  Mm' 
boa  rd  member  1  od* pendent  1  v  riamt  rta  -1  * 

large  sample  of  ape>  law*  •  onet  ru<  i  »•  : 
airman  rei  url*  taken  f  rom  t  »«e  moat 
rerent  promotion  <  y<  lr  end  provt  l«- •! 
promotion  evaluations.  T>e  promotion 
dacialooa  (urnlat«e<5  by  t  lie  ripe  r  ime'it  a  i 
board  provided  1 neiessary  Informs 
tion  for  t  be  anal  rei*  ptiaae  of  t  <ie  pro 
jet  t  .  TVie  ma  t  fie  ms t  I  <  a  J  art 
known  aa  poll'  v  <  apt  o  ring  vat  used  to 
model  i  tie  promotion  detlalon  polity  of 
the  experimental  board.  Ail  e*  pe ;  1 
mental  ayatems  wbl>  t.  were  developed 
during  t  tie  analysis  pfiase  were  e  va  1  u 
ated  in  terms  of  tiielr  alallarltv  to 
the  current  systea  and  titelr  lap*  t  o, 
women  and  ainorltlea. 

Tite  WAPS  provides  t  fie  Air  ►  o  r  <e  with 
an  enlisted  promotion  ayatem  that  la 
both  "equitable  and  visible",  1.*., 
promotion  opportunities  are  equal 
across  AfSa,  procedures  are  easily 
understood  and  accepted  by  airmen  with¬ 
in  the  ayatem,  and  Individual  feedback 
la  provided  to  all  ellglblea.  RAD 
results  from  this  reevaluation  effort 
will  provide  enlisted  promotion  policy 
makers  with  a  current,  scientifically 
defensible  basis  for  making  Improve¬ 
ments  to  the  operational  WAPS.  Thin, 
in  turn,  will  assure  that  the  best  and 
most  deserving  enlisted  personnel  are 
promoted  to  the  Important  mldlevel 
grades  and  will  Impact  positively  on 
retention  rates,  quality  of  perform¬ 
ance,  and  morale. 

The  WAPS  reevaluation  effort  was  com¬ 
pleted  and  the  results  and  conclusions 
have  been  presented  through  the  chain 
of  command  to  the  Air  Staff.  Policy 
makers  at  the  Air  Staff  level  are  now 
evaluating  and  considering  the  final 
outcomes. 

Contact:  Mr.  C.  Deene  Gott 

AFHRL/MOMM 

Brooks  AFB,  TX  78235-5601 

Commercial  (512)  536-3942 

AUTOVON  240-3942 
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TBCRNICAL  SERVICES  DIVISION 


COMPUTER  PROGRAMMING  BRANCH 


The  Technical  Services  Division,  lo¬ 
cated  at  Brooks  APB,  Texas,  provides 
support  to  tbs  AFBRL  Haadquartsrs  and 
tha  four  RAD  Divisions.  This  support 
includes  management  and  operation  of 
tha  scientific  date-processing  center 
of  APRIL.  Office  automation  services 
are  also  provided  by  the  Division. 
Manageamat  information  is  maintained 
on  a  computer  system.  Tha  Division 
develops,  sMintains,  and  updates  auto¬ 
mated  personnel  and  training  RAD  data¬ 
bases.  The  Division  also  provides  con¬ 
sultative  and  programming  support  in 
the  formulation  of  RAD  efforts  and  the 
application  of  statistical  techniques 
in  support  of  other  Laboratory  Divi¬ 
sions  and  other  Air  Force  offices.  The 
major  organisational  elements  within 
the  Division  are  the  Computer  Program¬ 
ming  Branch  and  the  Computer  Operations 
Branch.  The  Division  also  includes 
the  Information  Resources  Management 
Office  and  the  Scientific  and  Technical 
Information  Office. 


Dr.  Robert  A.  Bottenberg 
Division  Chief 


The  Computer  Programming  Branch  pro¬ 
vides  three  services: 

1.  Software  Development. 

2.  Database  Management. 

3.  Research  Processing. 

Software  Development.  The  Computer 
Programming  Branch  develops,  maintains, 
documents,  and  provides  training  in  the 
use  of  general-purpose  computer  soft¬ 
ware.  This  software  includes  the  broad 
categories  of  (a)  language  translators, 
such  as  precompilers  and  interpreters; 
(b)  utility  programs,  such  as  sort / 
merge  and  report  writers;  (c)  applica¬ 
tions  programs,  such  as  correlation- 
regression  analysis  and  multidimen¬ 
sional  frequency  distributions;  and  (d) 
subroutine  libraries  containing  common 
computing  algorithms.  The  Computer 
Programming  Branch  is  responsible  for 
more  than  460  general-purpose  and  sta¬ 
tistical  analysis  programs  and  3,080 
pages  of  user  guides  to  those  programs. 


Database  Maintenance 


Database  Management.  The  analysis  of 
relationships  between  personal  charac¬ 
teristics  and  performance  during  an  Air 
Force  career  requires  the  extensive  use 
of  data.  Experimental  tests  and  per¬ 
formance  measurement  devices  are  admin¬ 
istered  in  a  research  setting,  and 
these  results  are  ordinarily  correlated 
with  information  about  experimental 
cases  using  other  information  developed 
on  the  same  cases  at  a  distant  point 
in  time,  either  earlier  or  later  than 
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th*  experimental  data.  Similarly , 
atudiaa  of  caraar  progression  and  fac¬ 
tors  ralatad  to  eucceeeful  completion 
and  to  attrition  require  the  analyst 
to  correlate  information  on  the  same 
individuals  across  a  time  span  of  sev¬ 
eral  years.  The  major  operational  com¬ 
mands,  where  background  and  performance 
data  on  military  personnel  are  ini¬ 
tially  acquired,  retain  these  data  for 
only  a  limited  period — ordinarily  less 
than  1  year.  In  order  to  facilitate 
R&D  on  the  Air  Force  personnel  and 
training  systems  by  AFHRL  researchers, 
autosuited  data  are  obtained  from  the 
major  operating  commands  on  a  recurring 
basis.  These  data  are  then  converted 
for  use  in  the  AFHRL  Computer  Center. 
Based  on  experience  with  specific 
analyses  and  studies  over  a  period  for 
years  by  AFHRL  researchers,  data  in 
these  master  files  are  then  reorganized 
in  a  manner  calculated  to  eliminate  as 
much  of  the  overhead  as  possible  in  the 
context  of  specific  studies.  Experience 
has  also  indicated  the  desirability  of 
combining  information  from  two  or  more 
master  file  sources  to  establish  ready- 
to-use  master  files  with  a  common  set 
of  data  for  each  case  in  the  file. 
The  availability  of  these  R&D  master 
files  makes  it  possible  for  researchers 
to  effectively  carry  out  comprehensive 
R&D  efforts  related  to  the  personnel 
and  training  systems  without  having  to 
initiate  arrangements  for  data  collec¬ 
tion  on  a  case-by-case  and  study-by¬ 
study  basis  with  field  locations  in 
major  operating  commands. 


The  AFHRL  R&D  master  files  contain  data 
that  reflect  the  personal  characteris¬ 
tics  of  officer  and  enlisted  personnel 
at  time  of  entry  to  active  duty,  per¬ 
formance  outcomes  during  flying  or 
technical  training,  career  status  at 
periodic  intervals,  and  information  re¬ 
lated  to  reenlistment  or  separation. 
Special  files  are  created  to  meet  long¬ 
term  study  requirements,  and  longitudi¬ 
nal  files  have  been  constructed  to  fa¬ 
cilitate  studies  in  career  development. 
Work  is  underway  to  build  dynamic 
officer  and  enlisted  database  systems 
capable  of  providing  responses  to 
operational  and  research  investigators. 
These  database  systems  will  eliminate 
the  requirements  for  many  small,  frag¬ 
mented  databases  and  further  reduce 
the  startup  time  and  cost  of  many 
personnel  R&D  efforts. 

Major  master  personnel  files  are  main¬ 
tained  historically  on  Air  Force 
enlisted  and  officer  personnel  and  in¬ 
clude  enlisted  strength  files  from 
1964,  officer  strength  files  from  1960, 
officer  effectiveness  report  files  from 
1956,  flying  training  files  from  1964, 
Air  National  Guard  Reserve  files  from 
1970,  separated  officer  files  from 
1963,  enlisted  separation  files  from 
1956,  Basic  Military  Training  files 
from  1956,  Officer  Training  School 
files  from  1973,  and  ROTC  participant 
files  from  1970.  These  files  are 
received  from  various  Air  Force  agen¬ 
cies,  such  as  the  Air  Force  Military 
Personnel  Center,  Air  Training  Command, 
Air  University,  and  Air  Reserve  Person¬ 
nel  Center.  Special  longitudinal  files, 
such  as  the  Airman  Gain/Loss  and  Offi¬ 
cer  Gain/Loss,  are  developed  in-house 
from  these  databases  and  significantly 
reduce  data  processing  requirements  in 
many  personnel  and  training  R&D 
efforts. 

In  order  to  understand  the  code  struc¬ 
tures  used  in  the  development  of  the 
personnel  files,  an  additional  database 
was  developed  and  is  maintained  by 
AFHRL.  This  database  is  the  File  Item 
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Personnel  Tape  Library 


Data  Organiser  (FIDO).  It  conaiata  of 
selected  data  elements  and  coda  defini- 
tiona  from  Air  Forca  Regulation  700-20, 
Air  Forca  Data  Dictionary,  and  aarliar 
coda  systems.  It  haa  on-lina  ratriaval 
capability  for  currant  and  hiatorical 
coda  values  with  dafinitiona  for  aach 
data  element  that  appaara  in  a  data 
fila.  Tha  databaaa  currently  containa 
over  1,100  Air  Forca  and  DOD-dafinad 
data  elements,  anabling  a  raaaarchar 
to  obtain  Engl iah-languaga  aaaninga  for 
aach  coda  value  in  effect  f«r  any  p*i- 
ticular  hiatorical  file.  K IDO  haa  prov¬ 
en  to  be  a  valuable  tool  for  iaproving 
databaae  accuracy,  both  at  AFHRL  and 
other  agencies. 


Technical  Services  Division  Personnel 
Perform  R&D  Data  Analysis 

Research  Processing.  The  complexity  of 
comprehensive  R&D  efforts  performed  by 
AFHRL  researchers  frequently  leads  to 
an  extensive  series  of  data-processing 
steps  and  use  of  AFHRL  computer  re¬ 
sources.  The  design  and  conduct  of 
these  data-processing  steps  in  many 
cases  requires  the  use  of  technical 
experts,  who  select  and  assemble  util¬ 
ity,  general-purpose,  and  statistical 
programs.  Some  efforts  also  require 
the  development  of  unique  software.  In 


many  cases  the  use  of  one  or  more  tech¬ 
nical  experts  who  have  a  working  knowl¬ 
edge  of  the  R&D  master  files  is  crit¬ 
ical.  The  Computer  Programming  branch 
maintains  «  staff  of  programmer  end 
database  experts  who  support  the  analy¬ 
sis  requirements  of  esearchers.  These 
services  are  performed  in  response  to 
approved  work  requests  initiated  by  all 
AFHRL  divisions.  These  same  services 
are  available  to  approved  agencies  out¬ 
side  AFHRL.  Work  requests  at  initiated 
on  behalf  of  the  outside  customers  and 
then  processed  in  the  same  manner  as 
those  for  the  AFHRL  divisions.  In  ad¬ 
dition  to  processing  these  work  re¬ 
quests,  the  Branch  performa  a  quality 
review  of  all  work  performed,  to  ensure 
complete  and  accurate  results.  Annu¬ 
ally,  the  Branch  services  over  200  R&D 
data-processing  requests. 

COMPUTER  OPERATIONS  BRANCH 

The  Computer  Operations  Branch  manages 
and  operates  a  computer  center  which 
includes  a  large-scale,  general-purpose 
Sperry  1100  computer  system  to  support 
R&D  programs  of  AFHRL  and  the  Aerospace 
Medical  Division  (AMD)  at  Brooks  AFB, 
and  the  Occupational  Measurement  Center 
(0MC)  and  the  Air  Force  Military  Per¬ 
sonnel  Center  (AFMPC)  at  Randolph  AFB. 
A  Digital  Equipment  Corporation  VAX 
8600  is  operated  by  the  Branch  to  pro¬ 
vide  specialized  support  to  the  Train¬ 
ing  Systems  Division  for  the  Instruc¬ 
tional  Support  System  (ISS)  and  the 
Advanced  On-the-job  Training  System 
(A0TS)  applications.  A  Digital  Equip¬ 
ment  Corporation  VAX  11/780  computer 
system  provides  automated  management 
information  systems  in  support  of  R&D 
projects  within  AFHRL  and  also  provides 
an  interface  with  the  Defense  Data 
Network  (DDN).  A  Wang  Laboratories  VS- 
100  computer  system  provides  office 
automation  support  within  AFHRL. 

The  computer  center  includes  a  magnetic 
tape  library  which  houses  15,000  active 
tape  reels.  These  tapes  contain  his¬ 
torical  data  from  Air  Force  personnel 
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f  i  las  ,  which  imc Iwdw  master  files, 
wrk  i  *|  (U««  cr««t<4  in  IIm  conduct 
•f  4at«-prMHii«|  wrk  requests,  ami 
•flam  and  application  software. 

Over  MM  authorised  ueere  access  th« 
Sparry  1100  ayatwa  via  dial-up  twle- 
phmwo  liaca,  dedicated  t«l«phoiM  lines 
(servicing  Mil  liana  Aft  and  Randolph 
Aft),  ami  direct  cmmci«4  terminals 
at  AFMBL,  Brooha.  Sparry  1100  ua«ri 
include  A FURL  ant  AMD  scientists  ant 
coot ractora ,  aa  wall  aa  survey  ana- 
lyata  f row  OMC  ant  AfMfC. 

The  Hans  VS- l 00  coayutrr  system  pro- 
vitaa  offica  autoawtion  aupport  within 
AFKRL.  Thia  ayataw  provides  local 
autoaMted  wort  procaaainf  capability 
ant  alactronic  nail  aarvica  to  the 
remote  APRIL  tiviaiona  ant  HQ  AF8C . 
Tha  Wang  tarninala  ant  printara  1 o- 
catat  throughout  AFHRL  (building  578) 
allow  uaara  to  craata,  adit,  rauaa, 
ant  print  raaaarch  raporta,  corraapon- 
tanca,  ate.  and  to  atora  documents  on 
wagnatic  tiaka  for  latar  ratriaval  aa 
naatat,  Tha  alactronic  wail  function 
allowa  tranaaiaaion  of  corraapontancv , 
raaaarch  raporta,  ate.  to  all  AFHRL 
tiviaiona  ant  HQ  AFSC. 


Airman  Developing  Graphics 
by  Computer 


Audio  ant  Visual  Conferencing  Graphics 

Tha  reamta  tiviaiona  <<f  AFHRL  ant  hast- 
quarters  are  equipped  with  a  visual/ 
graphics  t eleconfvrenc mg  system.  This 
system  s  imu  1 1  aneous  1  y  links  all  t  h>- 
AFHRL  aitea.  This  linkage  makes  it 
possible  to  conduct  a  presentation  at 
any  of  the  AFNRl.  sites,  with  participa¬ 
tion  at  each  of  the  other  sites.  The 
Advanced  Teleconferencing  Multi-media 
Communication  (ATMC)  equipment  is  the 
heart  of  the  viaual  conferencing  capa¬ 
bility.  One  ATMC  is  located  at  each  of 
the  remote  sites,  ant  one  system,  to¬ 
gether  with  a  backup,  is  located  at 
AFHRL  headquarters.  Each  ATMC  is  capa¬ 
ble  of  creating,  storing,  and  retriev¬ 
ing  digital  color  imagery  consisting 
of  teat,  graphs,  and/or  photographs  and 
subsequently  displaying  these  iauiges 
locally  on  large-acreen  display  ayatema 
or  on  color  amnitors.  Using  this  sys¬ 
tem,  full-acale  viaual  and  color  video 
conferences  can  be  conducted,  augmented 
by  voice  communication  channels  through 
a  sp  ally  deaigned  bridge  located  at 
AFHRL  eadquartera.  The  function  of 
the  bridge  ia  to  balance  voice  signals, 
sulking  it  poaaib'e  for  the  audio  con¬ 
ferencing  operator  to  monitor  the  con¬ 
ference  paaaively.  The  Office  can  pro¬ 
vide  varioua  types  of  color  output, 
auch  aa  textual  slides,  pie  charts,  bar 
graphs,  and  line  graphs,  suitable  for 
viewgraph  and  35mm  projection. 

Management  Information  System 

The  Information  Resources  Management 
Office  ia  also  the  focal  point  for  col¬ 
lecting  and  displaying  data  used  in  the 
management  of  the  AFHRL  technical  pro¬ 
gram.  The  software  for  input  of  data 
at  the  source  has  been  completed.  All 
laboratory  divisions  are  on  line  to  in¬ 
put  and  retrieve  work  unit  and  Job  Or¬ 
der  Cost  Accounting  System  (J0CAS)  pro¬ 
ducts.  Automated  data  transfer  is  being 
done  for  data  to  support  Air  Force,  De¬ 
partment  of  Defense,  and  Defense  Tech¬ 
nical  Information  Center  (DTIC)  data¬ 
bases.  Personnel  throughout  AFHRL  re- 


trieve  data  product  reports  using 

the  AFML  <«uk*N  and  the  Oracl*  data¬ 
base  management  system. 


BCIRMTIFIC  AM)  TECHNICAL  INFORMATION 

office 

The  Scientific  and  Technical  Informa- 
t ion  (ST1NP0)  Offica  plana  and  diracts 
the  ST  INFO  program,  including  t ha  tach¬ 
nical  library,  to  moot  tha  information 
naada  of  Laboratory  sciantiata  and 
tachniciana  in  managing,  monitoring, 
and  conducting  BAD.  STINFO  paraonnal 
idantify  tha  information  and  publicity 
naada  of  tha  Laboratory  and  davalop 
news  articlas,  newsletters,  raporta, 
brochuraa,  and  displays  to  aMat  thoaa 
naada.  Tha  Offica  also  pub',  is  has  tha 
AFMBL  Annual  Baport.  Tha  Offica 'a  tach¬ 
nical  aditing  function  reviews,  proc- 
aaaaa,  and  publishas  raaults  of  B4U 
projects  in  tha  form  of  tachnical  ra¬ 
porta,  journal  articlas,  spacial  ra¬ 
porta,  profaaaional  papara,  and  othar 
docuaMnta.  Tachnical  aditing  paraonnal 
provida  guidanca  to  authors  and  con¬ 
tract  snnitors  to  ansura  that  publica¬ 
tions  comply  with  Government  regula¬ 
tions  and  profaaaional  standards.  They 
also  monitor  distribution  of  AFHBL  pub¬ 
lications  and  aMintain  racorda  for  re¬ 
sponding  to  informational  requests  from 
tha  usar  and  sciantific  communities. 
The  Office  provides  liaiaon  services 
between  the  AMD  Public  Affairs  Office 
and  the  Laboratory.  The  Office  obtains 
clearance  of  information  for  public 
ra lease;  arranges  for  visits  and  serv¬ 
ices  of  reporters,  photographers,  and 
audiovisual  specialists;  and  performs 
special  public  relations  and  informa¬ 
tion  assignments  as  required.  Finally, 
the  Office  maintains  the  AFHRL  histor¬ 
ical  archives,  answers  historical  in¬ 
quiries,  and  provides  information  for 
the  AMD  History. 

Technical  Library 

The  services  provided  by  the  AFHRL  li¬ 
brary  include  the  acquisition  of  books, 
journals,  and  other  library  materials. 


AFHRL  Technical  Library 


Services  are  provided  for  the  command 
staff  offices  and  the  divisions  on 
Brooks  AFB,  as  well  as  for  divisions 
and  offices  located  in  other  geograph¬ 
ical  areas.  The  library  has  on-line 
accasa  to  the  Dialog  Information  Serv¬ 
ices,  Inc.,  at  Palo  Alto,  California; 
the  Defense  Technical  Information  Cen¬ 
ter's  Defense  RDTAE  On-Line  System,  at 
Alexandria,  Virginia;  and  the  OCLC,  a 
national  library  network,  through  the 
AMIGOS  Bibliographic  Council,  Inc., 
Dallas,  Texas. 

During  the  fiscal  year,  the  Library 
staff  accomplished  129  on-line  litera¬ 
ture  searches.  Library  holdings  at  the 
end  of  FY86  were  12,535  books  and 
bound  volumes  of  journals,  10,976 
technical  reports,  and  454  journal 
subscriptions. 


FY86  ACCOMPLISHMENTS 

Major  upgrades  to  the  Sperry  computer 
system  were  completed.  New  disk  stor¬ 
age  equipment  was  installed,  providing 
faster  access  and  a  130X  increase  in 
disk  storage.  A  new  tape  subsystem  was 
installed  to  replace  older  equipment. 
Twelve  new  tape  drives  process  data  at 


6,250  elxricuri  per  inch,  compared 
with  1,600  characters  per  inch  for  the 
older  equipment.  The  new  drives  oper¬ 
ate  with  signi f icant ly  iaproved  reli¬ 
ability,  and  lessen  the  delay  experi¬ 
enced  by  interactive  users  of  the 
Sperry  systea.  A  second  Sperry  Central 
Processing  Unit  and  a  front-end  proc¬ 
essor  were  also  installed.  The  net 
effect  of  the  Sperry  systea  upgrades 
has  been  to  provide  users  of  the  systea 
with  iaproved  turnaround  and  the  abil¬ 
ity  to  sMintain  and  use  sore  files  in¬ 
teractively.  A  Digital  Equipaent  Cor¬ 
poration  VAX  8600  systea  was  installed 
and  placed  in  operation  to  support  the 
scientific  data-processing  requirements 
of  Training  Systeas  Division  personnel. 
Ada,  FORTRAN,  and  PASCAL  compilers  are 
available.  The  systea  will  be  used 
initially  to  support  further  develop¬ 
ment  of  the  Instructional  Support  Sys¬ 
tea  software,  and  to  support  extensive 
data-processing  requirements  for  the 
Advanced  On-the-job  Training  System 
effort  being  carried  out  at  the  Berg¬ 
strom  AFB  operating  location.  Addi¬ 
tional  disk  storage  and  tape  drive 
equipment  were  installed  in  the  Digital 
Equipment  Corporation  VAX  11/780  to 
support  increasing  requirements  for 
financial  and  project  management  data. 

Twelve  workstations  and  four  printers 
were  added  to  the  Wang  office  automa¬ 
tion  system  at  Brooks  AFB.  This  brings 
the  total  to  40  workstations  and  19 
printers,  and  provides  ready  access  to 
office  automation  by  an  increasing  num¬ 
ber  of  professional  and  technical  em¬ 
ployees.  Increased  processing  speed 
and  additional  ports  were  made  avail¬ 
able  for  workstations  and  printers 
through  the  upgrading  of  the  VS-90  CPU 
to  a  VS-100.  Increasing  disk  storage 
to  the  systems  enables  all  files  to  be 
backed  up  daily  and  minimizes  the  loss 
of  documents  previously  experienced 
when  backup  operations  were  less  fre¬ 
quent.  Hardware  installation  and  modi¬ 
fication  permitted  the  optical  mark 
reader  to  detect  identification  infor¬ 
mation  on  answer  blanks  used  in  ASVAB 
testing. 


A  project  to  convert  hard-copy  documen¬ 
tation  on  inactive  data-processing  work 
request  studies  to  microfiche  was  com¬ 
pleted  during  FY86.  Eight  tons  of  con¬ 
verted  hard-copy  documentation  were 
salvaged.  Equipment  has  been  procured 
and  procedures  instslled  to  convert  new 
inactive  study  documentation  annually. 

Quarterly  processing  of  Officer  Effec¬ 
tiveness  Report  summary  data  was  com¬ 
pleted  in  FY86.  This  processing  sup¬ 
port  has  been  provided  continuously  to 
AFMPC  since  1975. 

The  technical  library  installed  an  On¬ 
line  Computer  Library  Center  (OCLC)  M- 
300  terminal.  This  equipment  signif¬ 
icantly  increases  the  speed  of  on-line 
literature  searches  by  making  it  pos¬ 
sible  for  the  operator  to  view  and  se¬ 
lect  information  displayed  on  a  screen. 
It  provides  the  means  for  establishing 
and  maintaining  an  on-line  serials  con¬ 
trolled  database,  which  supersedes  the 
previous  manual  method  for  logging  the 
receipt  of  journals.  The  M-300  also 
significantly  reduces  the  time  required 
for  on-line  cataloging  and  interlibrary 
loan  transactions. 


Pictorial  Display  of 
Laboratory  R&D 


A  pictorial  display  portraying  contem¬ 
porary  RAD  was  prepared  and  Installed 
in  the  second  floor  lobby  of  AFHRL  at 
Brooks  APB.  A  folding  upright  portsble 
display  was  obtained  and  equipped  with 
photographs  portraying  laboratory  pro¬ 
grams  and  operations.  Displayed  near 
the  Command  section  In  the  headquarters 
building,  It  can  be  easily  dismantled 
and  shipped  to  conference  sites.  The 
AFHRL  FY85  Annual  Report  was  published 
In  December  1985  to  publicize  the  work 
of  the  Laboratory  and  Its  achievements. 

Thirty-two  Laboratory  personnel  were 
provided  In-house  training  in  the  use 
of  the  Z-100  microcomputers.  The  Author 


System  for  Education  and  Training 
(ASET),  computer-assisted  Instruction 
containing  16  programming  courses,  was 
used  as  the  basis  for  training  37 
users. 

During  FY86,  work  was  completed  on  303 
studies  carried  out  In  support  of  data- 
processlng  work  requests.  Major  re¬ 
questers  included  the  research  divi¬ 
sions  and  staff  offices  within  the  Lab¬ 
oratory,  the  Occupational  Measurement 
Center  of  Air  Training  Command,  the 
Rand  Corporation,  the  USAF  School  of 
Aerospace  Medicine,  the  Air  Force  Mil¬ 
itary  Personnel  Center,  and  the  U.S. 
Department  of  Justice. 
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Col  Jarvi  and  Dr.  Wagener  Sign  Agreement 


On  24  February  1986,  Col  Jarvi,  Com¬ 
mander  of  AFHRL,  and  Dr.  Wagener,  Pres¬ 
ident  of  t'le  University  of  Texas  at  San 
Antonio  (UTSA),  signed  a  Memorandum  of 
Agreement  (MOA).  The  major  provision 
of  the  MOA  is  to  allow  UTSA  faculty  and 
students  to  use  AFHRL  research  facili¬ 
ties  at  Brooks  Air  Force  Base.  The  use 
of  these  facilities  and  equipment  will 
be  in  support  of  the  AFHRL  mission.  The 
Laboratory  benefits  from  the  agreement 
through  the  addition  of  technical  ex¬ 
pertise  to  its  R&D  program;  likewise, 
the  University  benefits  through  experi¬ 
ence  gained  by  its  faculty  and  stu¬ 
dents  in  supporting  AFHRL  R&D  goals. 
Strengthening  DO D  and  University  ties 
is  a  national  priority  and  a  specific 


Air  Force  goal.  This  MOA  is  a  first 
step  in  achieving  that  goal. 

Dr.  Philip  Olivier,  a  professor  of  en¬ 
gineering  at  the  University  of  Texas 
at  San  Antonio,  has  already  realized 
the  benefits  of  the  MOA.  He  has  util¬ 
ized  the  equipment  and  expertise  of  the 
Training  Systems  Division  to  research 
control  systems  and  control  design  in 
artificial  intelligence.  Dr.  Olivier 
is  in  the  process  of  designing  and  im¬ 
plementing  an  Intelligent  Tutoring 
System  to  teach  the  interpretation  of 
circuit  design  using  problem-solving 
strategies  developed  by  the  mathemati¬ 
cian  Polya. 


DIVISION  ADVISORY  GROUP  VISIT 


Ob  1-2  Nap  19M,  the  Aerospace  Medical 
Dlvlaloa  Advisory  Group  (DAG)  visited 
the  AFHRL  facility  at  Vllllaaa  AF1,  AZ. 
The  first  day  of  the  visit  beset,  with 
so  executive  session  led  by  NaJ  Cen 
Predric  Doppelt  (HQ  AMD/CC),  which  was 
followed  by  a  welcowe /Introduction  f row 
Lt  Col  Kilgore  ( AFHRL/ OTD),  who  spoke 
on  slaulation  and  training  effective¬ 
ness  RAD  issues.  The  visitors  were 
then  given  an  extensive  tour  of  the 
facility.  During  the  tour,  briefings 
and  deaonst rat  Iona  were  presented  on 
all  the  aajor  efforts  currently  In  pro¬ 
gress.  These  Included  the  Fiber-Optic 
Heleet -Mounted  Display,  Part-Task 
Training,  LANTIRM,  Advanced  Visual 
Technology  Systea,  Fighter  Lead-In 
Training  RAD,  Electronic  Cow bat  Train¬ 
ing  RAD,  Slaulation  and  Training  Effec¬ 


tiveness,  Doee  Technologies,  Visual  and 
Sensor  Issues,  Cow bat  Mission  Trainer, 
and  Slaulator  Instructional  Technology. 
A  presentation  by  Dr.  Elisabeth  Martin 
(AFHRL/OTE)  on  basic  research  effort# 
was  also  Included  In  the  tour.  Future 
projects  such  as  Aircrew  Coabat  Ml  as  ion 
Enhanceaent  and  Artificial  Intelligence 
were  also  presented. 

The  second  day  began  with  a  briefing 
by  Col  John  Wolcott  (Deputy  Coaaander/ 
Director  for  Research,  Developaent  and 
Acquisition,  AMD)  on  Forecast  II  -  la¬ 
pse  t  and  Strategy  lapllcatlona  for  the 
Aerospace  Medical  Division.  The  rest 
of  the  day  involved  a  discussion  of  re¬ 
port  writing  asslgnaents  by  the  DAG,  an 
executive  session  by  Gen  Doppelt,  and 
a  final  dlscusslon/concluslons  session. 


Major  General  Fredrlc  Doppelt  and  Lieutenant  General  George  Sylvester 
(retired,  USAF)  watch  as  Captain  Karl  Towle  demonstrates  project. 


Caft  Jaflnn 


ARTIFICIAL  INTELLIGENCE:  NEVi  FRONTIERS 


Lt  Cal  L.  I 

kimUlDl 


On  3-4  September,  the  state  of  the  art 
of  Intelligent  Tutoring  Systems  (ITS)  and 
the  most  recent  research  findings  in  Ar¬ 
tificial  Intelligence  (AI)  were  discussed 
at  the  "1986  Air  Force  human  Resources 
Laboratory  Research  Planning  Forum  for 
Intelligent  Tutoring  Systems."  The  sym¬ 
posium  was  an  event  of  historical  Impor¬ 
tance  for  the  field  of  artificial  intel¬ 
ligence. 


Dr.  Imtlrmy  llcherdao 
Univ.  CO.  Boulder 


Dr.  John  Anderson 
Cm  m«f  le-Me  1 1  on 


World-renowned  educators,  psychologists, 
and  computer  scientists  met  to  discuss 
the  results  of  their  past  research  ef¬ 
forts  and  to  formulate  new  directions  for 
future  artificial  intelligence  tor  this 
Laboratory.  The  forum  was  composed  of 
some  of  the  most  notable  proponents 
of  AI,  persons  who  have  essentially  built 
its  foundation. 


Dr.  PmmIa  Pink 
Southmat  Research  Inst. 


Gunter  Hotel 


Dr.  Beverly  Woolf 
Univ.  of  MA,  Aaheret 


Dr .  Janes  Greene 
Univ.  of  CA.  feerfcel 


Dr.  Elliot  Solouey 
tale  Uni*. 


Dr.  Henry  Halff 
Halff  Resources,  Inc. 


<£  i 


Dr.  Kathleen  S*ig#sr 
North  Terns  Stars  Uni’ 


% 


A 


Dr.  David  Merrill 
Univ.  of  Southern  CA 


Dr.  Will  lea  Johnson 
Search  Tsch.  Inc. 
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AFHRL  MAJOR  AWARD  WINNERS 


;S 


Dr.  Jeffrey  E.  Kantor 
Winner  of  the  Donald  B.  Haines  Award 


The  1985  Donald  B.  Haines  Award  was 
presented  to  Dr.  Jeffrey  E.  Kantor  for 
his  outstanding  work  in  the  selection 
and  classification  of  Air  Force  pilots 
and  navigators.  Dr.  Kantor  and  his  re¬ 
search  team  developed  a  battery  of  15 
computer-administered  tests  designed 
to  measure  abilities  relevant  to  pilot 
performance  that  are  not  measured  in 
conventional  tests.  His  efforts  have 
resulted  in  R&D  programs  being  adopted 
by  NATO  and  the  Royal  Australian  Air 
Force. 


The  AFHRL  Management  Award  for  1986  was 
presented  to  Mr.  Ray  Martinez  on  30 
July  1986.  During  1985,  Mr.  Martinez 
managed  projects  involving  the  procure¬ 
ment,  installation,  and  operation  of 
scientific  computers,  management  infor¬ 
mation  computers,  and  office  automation 
systems.  He  was  also  instrumental  in 
the  analysis  of  requirements  for  the 
acquisition  of  a  large-scale  computer 
system  to  support  the  research  mission 
of  the  Training  Systems  Division  as  it 
relocated  to  Brooks  AFB  from  Lowry  AFB. 


Mr.  Ray  Martinez 

Winner  of  the  AFHRL  Management  Award 


Mr.  Richard  E.  Lamb 
DOD  Handicapped  Employee  of  the  Year 


Mr.  Richard  E.  Lamb  of  the  Human  Re¬ 
sources  Laboratory  at  Wright-Patterson 
AFB  attended  ceremonies  at  the  Pentagon 
on  7  October  1986,  in  honor  of  his  se¬ 
lection  as  the  DOD  Handicapped  Employee 
of  the  Year.  Mr.  Lamb  was  recognized 
for  developing  and  implementing  a  plan 
to  verify  and  validate  the  Mission  Re¬ 
liability  Model,  which  will  be  used  to 
assess  the  reliability  of  integrated 
communications,  navigation,  and  avion¬ 
ics  circuits  of  future  Air  Force  weap¬ 
on  systems.  Blind  since  birth,  Mr. 
Lamb  uses  a  reading  device  which  con¬ 
verts  standard  print  into  braille  to 
help  him  in  his  dally  work  with  statis¬ 
tics,  data  analysis,  and  computer  simu¬ 
lation. 


AFHRL  AIRMEN  AMONG  AIR  FORCE  SYSTEMS  COMMAND 
OUTSTANDING  AIRMEN  OF  THE  YEAR 


MSgt  Joseph  Singleton  Is  an  Instruc¬ 
tional  Systems  Training  Manager  in  the 
Training  Systems  Division.  He  has  con¬ 
tributed  a  great  deal  to  the  Advanced 
On-the-job  Training  System  (AOTS)  proj¬ 
ect.  He  developed  clear  and  comprehen¬ 
sive  AOTS  brief  logs,  as  well  as  duty 
titles  and  position  descriptions  for 
the  Instructional  Systems  Team  cadre. 
MSgt  Singleton  also  co-developed  the 
AOTS  Personnel  and  Support  Subsystem, 
which  Identifies  HQ  Air  Force  to  base- 
level  personnel  requirements  and  re¬ 
sponsibilities  for  management  of  Air 
Force  on-the-job  training  under  AOTS. 


TSgt  Robert  Swindell  provided  an  exten¬ 
sive  computer  background  and  experience 
in  the  Airman  Personnel  Data  System  of 
the  Advanced  On-the-job  Training  System 
project  as  an  Instructional  Systems 
Supervisor  in  the  Training  Systems  Di¬ 
vision.  His  Interaction  with  local 
work  centers  in  the  preliminary  design 
of  AOTS  was  vital  to  the  project.  His 
inputs  to  the  contractor  in  the  prelim¬ 
inary  design  and  development  of  Comput¬ 
er-Assisted  Instruction  and  Computer- 
Managed  Instruction  were  invaluable. 


SrA  David  LeBrun  was  recognized  for  his 
timely  and  accurate  completion  of 
large-scale,  complex  statistical  analy¬ 
ses  in  support  of  manpower,  personnel, 
and  training  R&D.  He  is  a  Computer 
Programmer/Analyst  in  the  Technical 
Services  Division.  SrA  LeBrun  com¬ 
pleted  15  studies  in  the  past  year, 
with  several  of  them  supporting  R&D  on 
the  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB)  directed  by  the  Joint 
Services  Selection  and  Classification 
Working  Group. 


MSgt  Joseph  Singleton 


TSgt  Robert  Swindell 
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AFHRL  MILITARY  AWARD  WINNERS 


Capt  Antoinette  Wegner 


The  1985  Brooks  AFB  Outstanding  Woman 
of  the  Year  Award  in  the  Officer  cat¬ 
egory  went  to  Capt  Antoinette  Wegner, 
a  Behavioral  Scientist  in  the  Manpower 
and  Personnel  Division.  She  identified 
and  solved  interpretation  problems  in 
a  major  joint-Service  test,  planned  and 
executed  contract  efforts  totaling  over 
$1,000,000,  and  analyzed  the  impact  of 
personnel  testing  at  the  Air  Staff  and 
DOD  levels  for  technical  and  policy 
level  decisions. 


1st  Lt  Amy  E.  Potts 


1st  Lt  Amy  E.  Potts  was  selected  as  the 
AMD  1985  Company  Grade  Officer  of  the 
Year.  As  the  Program  Control  Officer 
in  the  Advanced  On-the-job  Training 
System  project,  she  isolated  factors 
that  could  lead  to  contractual  cost, 
schedule,  and  performance  problems. 
As  a  direct  result,  the  Air  Force  ini¬ 
tiated  actions  to  correct  contractor 
management  of  this  critical,  multimil- 
lion-doilar  AOTS  effort. 


MSgt  Leeroy  Burrell 


MSgt  Leeroy  Burrell  of  the  Logistics 
and  Human  Factors  Division  was  selected 
as  the  AMD  Senior  Enlisted  Administra¬ 
tor  -  Unit  Administration  -  of  FY85. 
He  was  also  nominated  as  the  1985  AFSC 
Senior  Enlisted  Administrator  -  Admin¬ 
istrative  Management.  Although  Ser¬ 
geant  Burrell  was  not  selected  as  the 
Command  nominee  for  this  category,  he 
was  awarded  an  HQ  AFSC  Certificate  of 
Recognition  for  his  expertise,  profes¬ 
sionalism,  and  dedication  in  the  field 
of  administration. 


TSgt  Joanna  Nixon 

TSgt  Joanna  Nixon,  a  Computer  Program¬ 
mer  in  the  Logistics  and  Human  Factors 
Division,  won  the  ASD  Black  Employment 
Program  Achievement  Award  for  Community 
and  Youth  Service.  She  has  devoted 
much  of  her  time  to  young  people,  con¬ 
ducting  children's  activities  for  the 
Noncommissioned  Officers  Association 
Bike-a-Thon  and  raising  over  $500  to 
provide  toys  for  underprivileged  youth, 
volunteering  her  time  to  telethons, 
and  serving  as  a  foster  parent. 


OUTSTANDING  AFHRL  CIVILIANS 


Jimmy  D.  Souter 

Professional  Civilian  of  the  Year 

Mr.  Souter,  former  Chief  of  the  Comput¬ 
er  Programming  Branch,  Technical  Serv¬ 
ices  Division,  contributed  a  great  deal 
to  the  R&D  of  AFHRL  through  his  skill 
and  expertise.  A  few  of  his  accomplish¬ 
ments  Include  the  analysis  of  data  on 
enlisted  and  officer  promotion  trends, 
the  development  of  master  files  for 
research  and  development,  and  partici¬ 
pation  in  a  study  involving  the  relo¬ 
cation  of  computer  support  from  the 
Training  Systems  Division  at  Lowry  to 
Brooks  AFB. 


James  L.  Friemann 


Technical  Civilian  of  the  Year 


Harriet  K.  Renlck 
Clerical  Civilian  of  the  Year 

Ms.  Renick  serves  as  Personal  Adminis¬ 
trative  Assistant/Secretary  to  the 
Chief  of  the  Technical  Services  Divi¬ 
sion.  A  truly  deserving  recipient, 
Ms.  Renlck  has  developed  a  detailed 
handbook  of  office  policies  and  proce¬ 
dures,  as  well  as  a  computerized  system 
to  monitor  Civilian  Policy  Board  infor¬ 
mation.  She  is  considered  an  expert  on 
office  automation  equipment  and  is 
often  called  upon  to  demonstrate  com¬ 
plex  functions. 


Mr.  Friemann,  a  Supervisory  Computer 
Systems  Analyst  in  the  Technical  Serv¬ 
ices  Division,  is  responsible  for  the 
computer  design  and  programming  of  data 
analysis  projects.  His  achievements  in¬ 
clude  the  analysis  of  item  responses  on 
265,000  ASVAB  tests,  a  labor  management 
survey  to  identify  or  resolve  problems 
in  civilian  labor  management,  and  WAPS 
revalldatlon  data.  This  award  recog¬ 
nizes  the  high  productivity  and  impact 
of  his  data  processing  function. 


Ms.  Wilson  is  a  Management  Assistant  in 
the  AFHRL  Plans  and  Operations  Office. 
She  serves  as  the  management  focal 
point  for  Air  Force  R&D  requirements, 
such  as  Requests  for  Personnel  Re¬ 
search,  Technology  Needs,  and  Logistics 
Needs.  She  is  quite  an  asset  to  AFHRL 
by  virtue  of  her  expertise  in  using  the 
word  processing  system,  her  exceptional 
leadership  skills,  and  her  effective 
oversight  of  AFHRL  Memoranda  of  Agree¬ 
ment. 


SUMMER  FACULTY  RESEARCH  PROGRAM 


The  USAF  Summer  Faculty  Research  Pro¬ 
gram,  sponsored  by  the  Air  Force  Office 
of  Scientific  Research,  provides  op¬ 
portunities  for  qualified  faculty  mem¬ 
bers  of  U.S.  educational  institutions 
to  conduct  research  in  areas  such  as 
computer  science,  industrial  and  ex¬ 
perimental  psychology,  and  engineering. 
Researchers  are  able  to  pursue  an  area 
of  interest  for  a  10-week  period  during 
the  summer  at  one  of  21  USAF  labora¬ 
tories  across  the  U.S.  Follow-on  re¬ 
search  opportunities  are  also  available 
under  the  Research  Initiation  Program, 


which  allows  a  maximum  of  $20,000  to 
pursue  further  a  particular  area  of 
interest. 

The  objectives  of  this  program  are: 
(a)  to  enhance  the  research  interests 
and  capabilities  of  scientific  and  en¬ 
gineering  educators  in  areas  of  inter¬ 
est  to  the  Air  Force,  (b)  to  stimulate 
continuing  relations  among  faculty  mem¬ 
bers  and  their  professional  peers  in 
the  Air  Force,  and  (c)  to  allow  the  Air 
Force  to  continue  research  of  Interest 
at  the  faculty  member's  institution. 


The  following  researchers  were  participants  in  the  1986 
Summer  Faculty  Research  Program 


Logistics  and  Human  Factors  Division 

Patricia  T.  Boggs:  Decision-Making 
Paradigms  in  the  Design  and  Implemen¬ 
tation  of  Adaptive  Decision-Making 
Aid 8,  Wright  State  University. 

Raghava  G.  Gowda:  Structured  Tech¬ 
niques  for  IMIS  Software  Development, 
University  of  India. 

Stephen  L.  Loy:  Visual  Problem-Struc¬ 
turing  and  Hemispheric  Processes  of  the 
Human  Brain,  Iowa  State  University. 

Shreenlvas  Moorthy:  Human  Factors 
Analysis  of  Microcomputer-Based  Main¬ 
tenance  Systems  for  Advanced  Combat 
Aircraft,  Texas  A&I  University. 


Manpower  and  Personnel  Division 

Dr.  Phil  Tomporo8kl:  Individual  Dif¬ 
ferences  in  Vigilance  Behavior  of  Mili¬ 
tary  Personnel,  University  of  Alabama. 

Dr.  Jorge  Mendoza:  Methods  of  Correct¬ 
ing  Validity  Coefficients  for  Effects 


Due  to  Range  Restrictions,  Texas  A&M 
University. 

Dr.  Richard  Cox:  Studies  to  Improve 
Prediction  of  Pilot  Success  Based  on 
Two-Hand  and  Complex  Coordination  Psy¬ 
chomotor  Tests,  Kansas  State  Univer¬ 
sity. 


Operations  Training  Division 

Dr.  Marylou  Cheal:  Visual  Attention, 
University  of  Dayton. 

Dr.  Garvin  Chastain:  Visual  Attention, 
Boise  State  University. 

Dr.  A.  Hariman:  Germ  Warfare,  Okla¬ 
homa  State  University. 

Dr.  Bill  Wooten:  Color  Vision,  Brown 
University. 

Dr.  Ed  Hass:  Mental  Rotation,  Franklin 
and  Marshall. 

Susan  Abrahms:  Form  Perception,  Uni¬ 
versity  of  Illinois. 


Laura  Sevall:  Color  Perception,  Brown 
University. 

Dr.  Bill  Shonts:  Contrast  Sensitivity, 
Montana  State  University. 


Training  Systems  Division 

Dr.  Doris  Walker-Dalhouse:  Reading 
Cosiprehension  and  Discourse  Analysis, 
Jackson  State  University. 

Dr.  Doris  Ginn:  English  and  Sociolin¬ 
guistics,  Jackson  State  Universiy. 

Dr.  Phil  Olivier:  Control  Systems/ 
Design,  Artificial  Intelligence,  Com¬ 
puter-Aided  Instruction,  University  of 
Texas  at  San  Antonio. 

Dr.  Kathleen  Swigger:  Computer-Based 
Education,  Artificial  Intelligence, 
North  Texas  State  University. 


FORTY-FIVE  YEARS  OF  EXCELLENCE 

The  Air  Force  Human  Resources  Labora¬ 
tory's  45th  Anniversary,  celebrated  on 
9-10  October  1986,  did  indeed  mark  45 
years  of  excellence.  What  began  as  a 
single  Psychological  Research  Unit  es¬ 
tablished  on  15  November  1941  at  Kelly 
Field,  San  Antonio,  Texas  has  evolved 
into  a  vital  element  of  the  Air  Force 
dedicated  to  strengthening  its  human 
resources.  Other  predecessor  organiza¬ 
tions  of  AFHRL  include  the  Human 
Resources  Research  Center  (HRRC),  the 
Air  Force  Personnel  and  Training  Re¬ 
search  Center  (AFPTRC),  and  the  Person¬ 
nel  Research  Laboratory.  HRRC  was  ac¬ 
tivated  in  July  1949,  with  the  3309th 
R&D  Squadron  incorporated  as  the  Per¬ 
sonnel  Research  Directorate.  AFPTRC 
replaced  HRRC  on  1  February  1954  and 
continued  until  1962.  During  its  hey¬ 
day,  AFPTRC  had  almost  1,400  employees. 
Subsequently,  it  was  diminished  in  size 
and  redesignated  as  Detachment  Number 
1,  Wright  Air  Development  Center 
(WADC).  Later  the  6570th  Personnel  Re¬ 
search  Laboratory  was  established  as 
an  element  of  the  Aerospace  Medical 


Division  on  1  January  1962.  It  contin¬ 
ued  until  July  1968.  The  entire  con¬ 
tingent  of  AFHRL  was  moved  to  Brooks 
AFB  in  1977  and  was  assigned  to  Air 
Force  Systems  Command.  In  1983  AFHRL 
was  again  assigned  to  the  Aerospace 
Medical  Division. 

Although  AFHRL  was  established  in  1968, 
its  research  areas  span  over  four  dec¬ 
ades.  Some  of  AFHRL 's  past  research 
efforts  were  displayed  as  part  of  the 
"Window  to  Our  Past,"  which  was  un¬ 
veiled  during  this  Anniversary  celebra¬ 
tion.  This  "window"  pictorialized  the 
first  psychomotor  tests  used  by  AFHRL 
to  test  pilots.  Some  of  the  tests  fea¬ 
tured  were  the  Dynamic  Balance  Test, 
the  Finger  Dexterity  Test,  and  the  Com¬ 
plex  Coordination  Test.  The  Finger 
Dexterity  Test,  for  example,  consisted 
of  a  wooden  peg  board  with  48  square- 
bottomed,  round-topped  pegs.  Subjects 
had  to  remove  each  peg,  rotate  it 
clockwise  180  degrees,  and  reinsert  it. 
The  Complex  Coordination  Test  used 
three  double  rows  of  green  and  red 
lights  and  required  subjects  to  manip¬ 
ulate  a  joystick  to  light  a  green  light 
when  the  corresponding  red  light  ap¬ 
peared.  The  latter  test  was  the  basic 
psychomotor  test  used  for  pilot  selec¬ 
tion  in  WWII .  The  Window  to  Our  Past 
visually  illustrates  the  progress  AFHRL 
has  made  in  the  area  of  aircrew  selec¬ 
tion,  from  a  wooden  peg  board  to  the 
highly  sophisticated,  computerized 
Portable  Basic  Attributes  Test  used 
today. 

The  first  day  of  the  Anniversary  Cele¬ 
bration  began  with  the  dedication  of 
the  Window  to  Our  Past  followed  by  a 
discussion  of  AFHRL  current  events  and 
briefings  with  past  AFHRL  commanders. 
The  day  ended  with  a  festive  Texas- 
style  barbecue  and  a  speech  by  guest 
speaker  Col  Dan  D.  Fulgham,  a  former 
AFHRL  Commander.  On  the  second  day  of 
the  celebration  an  Open  House  was  held 
for  the  families  and  friends  of  AFHRL 
employees.  Tours  of  the  library,  the 
computer  facility,  and  the  Laboratory 
Operations  Center  were  conducted,  and 
exhibits  were  provided  in  the  lobby. 
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FISCAL  HIGHLIGHTS 

FUNDING  SUMMARY  (1000) 


FY84 

FY85 

FY86 

LABORATORY  DIRECTOR'S  FUND 

815 

945 

945 

RESEARCH  6.1 

830 

752 

1,368 

EXPLORATORY  DEVELOPMENT  6.2 

29,421 

30,557 

30,674 

ADVANCED  DEVELOPMENT  6.3 

15,215 

19,291 

16,804 

INTERSERVICE  TRANSFERS  & 
REIMBURSEMENTS 

10,966 

9,781 

13,495 

TOTAL 

57,247 

61,326 

63,286 

FY86 


DISTRIBUTION  OF 
FUNDING 


FUNDING  BY  DIVISION 
ALL  SOURCES 


|  6.2  LABORATORY  DEVELOPMENT  (48%) 

m  OPERATIONS  TRAINING 

(25.4) 

m  6.1  RESEARCH 

(4%) 

H  TRAINING  SYSTEMS 

(7.7) 

H  LABORATORY  DIRECTOR'S  FUND 

(1%) 

^  MANPOWER  ft  PERSONNEL 

(11.0) 

Wi  INTERSERVICE  TRANS  ft  REIMB 

(21%) 

LOGISTICS  ft  HUMAN  FACTORS 

(19.2) 

|  |  6.3  ADVANCED  DEVELOPMENT 

(26%) 
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DISTRIBUTION  OF  AUTHORIZED  PERSONNEL 

FY86 


■  OFFICERS  (25%) 

■  AIRMAN  (22%) 

■  CIVILIANS  (53%) 


BY  DIVISION 

MANPOWER  AND  PERSONNEL 
LOGISTICS  &  HUMAN  FACTORS 
OPERATIONS  TRAINING 
TECHNICAL  SERVICES 
TRAINING  SYSTEMS 
HEADQUARTERS 

TOTAL 


CLASSIFICATION 


81 

72 

OFFICERS 

105 

65 

AIRMAN 

95 

94 

CIVILIANS 

225 

70 

43 

TOTAL 

425 

425 


PERSONNEL  TYPES 


ACADEMIC  DEGREES 


■  NON-DEGREE 

■  BACHELORS 

■  MASTERS 
^  PhD 


(56%) 

(22%) 

(22%) 

(12%) 


■  SUPPORT  (22%) 

■  SCI  &  ENG  (52%) 

■  TECHNICAL  (26%) 


FY86 


AS  OF:  30  SEPT  86* 


•  CURRENT  ORGANIZATIONAL  CHART  IS 
PROVIDED  ON  PAGE  130. 


HRL-MB-1-1 


TECHNOLOGIES 

TRANSITIONED 


TECHNOLOGIES  TRANSITIONED 


MANPOWER  AND  PERSONNEL  DIVISION 

FY80  PROOUCTS 

Task  Analysis  Handbook 

Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  Forms  8,  9,  and  10 


Senior  Executive  Appraisal  System  (SEAS)  and 
General  Manager  Appraisal  System  (GMAS) 

Recruiter  Resource  and  Goa 1  Allocation  Model 

Organizational  Assessment  Package  (OAP) 

Weighted  Airman  Promotion  System  (MAPS) 
Impact  Analysis 

Enhanced  Likelihood  Function  Estimation 
(LIFE)  Model 

Air  Force  Occupational  Research  Data  Bank 
(OROB) 

FY81  PRODUCTS 

Job  Performance  Appraisal  System  (JPAS)  and 
Civilian  Potential  Appraisal  System  (CPAS) 

Enlistment  Screening  Test  (EST),  Forms  81A 
and  81 B 

Safety  Training  Priorities 

Job  Aptitude  Requirements 

Modification  of  Person- Job-Match  System 

Standardized  Position-Oriented  Training 
System  (SPOTS) 

Mission  Impact  Generalized  Explanatory  Base 
Operating  Support  Model  (GEBOS-M) 

Computer  Adaptive  Testing  (CAT)  Study  on 
Sample  Size  vs  Item  Pool  Size 

Handbook  on  Costs  of  the  First-Term 
Enlisted  Force 


USERS 

Air  Training  Command  (ATC) 

Office  of  the  Assistant  Secretary  of  Defense, 

Manpower,  Reserve  Affairs  A  Logistics  (OASD/MRA&L), 
All  Services 

HQ  USAF,  Directorate  of  Civilian  Personnel  (WK) 

HQ  USAF,  Office  of  Civilian  Personnel  Operations  (OCPO) 

HQ  Air  Force  Recruiting  Service  (USAFRS) 

Leadership  and  Management  Development  Center  (LMDC) 

HQ  USAF,  Directorate  of  Personnel  Plans  (MPX) 

USAFRS 

USAF  Occupational  Measurement  Center  (USAF/ONC) 

USERS 

HQ  USAF/MPK,  OCPO 

OASD/MRAiL,  All  Services 

Air  Force  Inspection  and  Safety  Center  (AFISC) 

Air  Force  Manpower  and  Personnel  Center  (AFMPC),  ATC 
AFMPC,  ATC 

HQ  USAF,  Directorate  of  Personnel  Programs  (MPP) 

HQ  USAF,  Directorate  of  Manpower  and  Organization  (MPN) 

OASD/MRAiL,  All  Services 

HQ  USAF /MPX 


Air  Force  Officer  Qualifying  Test  (AFOQT) 
For*  0  and  Officer  Screening  Composites 


USAFRS,  Officer  Training  School  (OTS) 

Air  Force  Reserve  Officer  Training  Corps  (AFROTC) 


FY82  PRODUCTS 

Air  Force  Reading  Abilities  Test  (AFRAT) 

National  Labor  Market  Research 

Occupational  Retraining  Guidelines  for 
Retrainee  Management 

Test  Battery  for  Air  Traffic  Controllers 

Physical  Strength  and  Stamina  Requirements 

Enlisted  Assignment/Reassignment  System  (EARS) 

FY83  PRODUCTS 


Modified  Non-Approprlated  Fund  (NAF) 
Supervisory  Appraisal  Form 

Alternative  Weighting  Systems  for  the  HAPS 

Classification  of  Situational  Constraints 
In  Air  Force  Work  Settings 

Enhanced  Hierarchical  Grouping  Computer 
Program  (HIER-GRP) 

ASVAB  Forms  11,  12,  and  13 

Historical  Airman  Database  (HAD)  Applications 

FV84  PRODUCTS 


Counselor's  Manual  and  Technical  Supplement 
for  ASVAB  Form  14 

Revised  NAF  Employee  Appraisal  Form;  Revised 
CPAS  Rating  Factors  and  Weights 

Air  Force  Systems  Command  (AFSC)  Incentive 
Awards  Survey 

Relationships  of  ASVA8  Forms  8,  9,  and  10 
and  Air  Force  Technical  School  Grades 

Subgroup  Norms  for  ASVAB  Form  14 

Validations  of  AFOQT 

Improved  Pilot  Selection  Systems 


USERS 

ATC,  All  Major  Commands  (MAJCOMs) 

HQ  USAF/MPX 
HQ  USAF/MPP,  AFMPC 

AFMPC,  ATC,  Air  Force  Communications  Command 

Armstrong  Aerospace  Medical  Research  Laboratory  (AAMRL) 

HQ  USAF/  MPX,  AFMPC 

USERS 

OCPO 

HQ  USAF/MPX 
LMDC 

USAF/OMC,  All  Services 

OASD/MRAiL,  All  Services 
HQ  USAF/MPX,  OSD 
USERS 

OASD/MRAiL,  All  Services 

OCPO 

HQ  AFSC/DPC 

AFMPC,  ATC 

OASD/MRAiL 

AFMPC,  HQ  USAF/MPX,  OTS,  AFROTC 
ATC 


HQ  USAF/MPX 


Statistical  Study  of  Enlisted  Retention 
Trends 

Procurement  Management  Information  System 
(PROMS)  RIO 

Validation  of  English  Diagnostic  Test  for 
Journalism-Related  Programs 

Skills  Projection  Analysis 

Improved  Selection  Procedures  for 
Air  Force  Physicians 

Mathematical  and  Statistical  Software  Index 
for  AFHRL  Uni  vac  1100  Computer  System 

Learning  Difficulty  Indices  for  Refinement 
of  Aptitude  Requirements 

Jet  Engine  Mechanic  Job  Performance  Measures 

Development  of  Computerized  Adaptive 
Testing  (CAT)  Item  Pools 

Development  of  1980  Norms  and  Conversion 
Tables  for  the  Enllstamnt  Screening 
Test  (EST) 

Enhanced  Comprehensive  Occupational  Data 
Analysis  Programs  (COOAP) 

FV85  PROOUCTS 

ASVAB  Deliberate  Failure  Keys 

ASVAB  14  Technical  Manual 

Psychomotor  Pilot  Selection  Systems 

Cognitive  Task  Analysis  Guide 

Learning  Difficulty  Technology 

Job  Performance  Measurement  Technology 

Policy  Specifying  Software 

Revised  Comprehensive  Data  Analysis  Programs 

Occupational  Research  Data  Bank 

Enhanced  Hierarchical  Grouping  Program 

Air  Force  Retention  Analysis  Package 


AFMPC,  ATC,  USAFRS 

HQ  AFSC/DL 

HQ  USAF/MPM 

Air  Force  Medical  Service  Center 

USAF/OMC,  School  of  Aerospace  Medicine 

AFMPC,  USAF/OMC 

HQ  USAF/MPX,  AFMPC,  0ASD/MRA4L ,  All  Services 
OASD/MRAIL,  All  Services 

OASD/MRAIL,  All  Services 

USAF/OMC,  All  Services 

USERS 

OASD/MRAIL,  All  Services 
AFMPC,  HQ  USAF/MPX,  AFROTC 
ATC,  Air  National  Guard 
ATC 

AFMPC,  USAF/OMC 
Army,  Navy 

USAF/OMC,  All  Services 
USAF/OMC,  All  Services 
USAF/OMC 

USAF/OMC,  All  Services 
HQ  USAF/MPX,  AFMPC 


OPERATIONS  TRAINING  DIVISION 

FT80  PRODUCTS 

SI  Ml  a  tor  for  Alr-to-AIr  Combat  (SAAC) 

Visual  Dysfunction  Study 

Interface  Between  SAAC  and  the  Advanced 
SlMlator  for  Pilot  Training  (ASPT) 

ASPT  Multiple  Moving  Models  Update 

A-10  Manual  Reversion  Flight  Control  System 
Simulation  RAD 

FT81  PRODUCTS 

Force  Cue  Requl resents  for  A-10  Alr-to- 
Surface  Weapons  Delivery  SlMlatlon 

Improved  F-16  Back-Up  Fuel  Control  (BUC ) 
Restart 

Transfer  of  Training  from  ASPT  to  REO  FLAG 
under  High-Threat  Conditions 

Operational  Test  and  Evaluation  Handbook  for 
Aircrew  Training  Devices 

Measurement  of  In-Flight  Electronic  Warfare 
Officer  (EWO)  Performance 

Visual  Acquisition  of  Air  Combat  Maneuvering 
Targets  In  the  SAAC 

Desk-Top  Trainer  DeMnstratlon 

Linear  Systems  Analysis  of  B-52  Weapons 
Delivery  Accuracy 

Guidelines  for  Management  of  Nonflying 
Intervals  for  Skills  Maintenance 

Surface  Attack  Mission  SlMlatlon 

RecomMndatlons  for  G-Cuelng  Devices  In 
Fighter-Type  SlMlators 

Vertical  Cue  Requirements  for  SlMlated 
Low-Altitude  Flight 

FV82  PRODUCTS 

U-2/TR-1  Cockpit  Procedures  Trainer 
(U— 2  CPT) 


USERS 

Air  Training  Command  (ATC), 

Tactical  Air  Command  (TAC) 

ATC,  TAC 

ATC,  TAC 
ATC,  TAC 

USERS 

TAC  and  USAF  Tactical  Air  Warfare  Center  (USAF/TAWC) 

ATC,  TAC 

ATC,  TAC 

Air  Force  Operational  Test  and  Evaluation  Center 
(AFOTEC),  MAJCOMs 

Strategic  Air  Command  (SAC) 

TAC 

TAC,  Military  Airlift  Command  (MAC),  SAC 
SAC 

MAJCOMs 

TAC,  SlMlator  Systems  Program  Office  (SIMSPO) 

TAC,  SIMSPO 

TAC,  SIMSPO 

USERS 

SAC 
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Biological  Correlates  of  Pilot  Workload  and  Stress  Air  Force  Office  of  Scientific  Research  (AFOSR) 


Visual  Display  System  Functional  Requirements  Aeronautical  Systems  Division  (ASD/EN) 

A-10  Combat  Scenario  Development  and  Evaluation:  TAC 

Low-Altitude  Simulation  Training 


F-16  Stores  Management  System  (SMS)  Training  Study 
FY83  PRODUCTS 

Integrated  Slaulator/AIrborne  Performance 
Measurement  System  for  C-5A 

Directed  Energy  (Laser)  Flash  Effects  Study 

Comparison  of  Some  Flight  Simulator  Visual 
Displays 

Assessment  of  Morkload  and  Prediction  of 
Performance  by  Combined  Psychophysl o- 
loglcal  and  Behavioral  Techniques 

Fiber  Optic  Helmet-Mounted  Display 


Low-Altitude  Database  Development  and 
Evaluation  Research 

Field  of  View  (FOV)  for  Selected  F-16 
Weapons  Delivery  Tasks 

Radar  Warning  Recel ver/Electronlc  Counter¬ 
measures  Part-Task  Trainer  (RWR/ECN  PTT) 

Generic  Threat  Recognition  Trainer 

FY84  PRODUCTS 

C-130E  Weapon  System  Trainer  Operational  Test  and 
Evaluation 

Advanced  Visual  Technology  System 

The  Tactical  Training  Center:  An  Integration  of 
Advanced  Simulator  and  Range  System  Concepts 

A-10  Close  Air  Support  Performance  In  a  Flight 
Simulator:  Effects  of  Visual  Display  Fleld-of-Vl 

A  Unitary  Measure  of  Performance  for  the  Close  Air 
Support  Mission 

Aircrew  Training  Task  Surveys 


TAC,  MAC,  SAC 
USERS 

MAC 

TAC,  Army 
MAJCOMs,  ASD/EN 

AFOSR,  Arizona  Air  National  Guard 

ASD,  Armstrong  Aeromedical  Research  Laboratory 
(AAMRL ) ,  Army,  Navy 

TAC 

TAC 

TAC,  SAC,  MAC 

SAC 

USERS 

MAC 

Army 

TAC,  Training  Data  Analysis  Center  (TDAC) 

TAC 

TAC 

MAC,  SAC 


Investigation  of  Real  Versus  Collimated  Imagery  In 
Flight  Simulator  Visual  Display 

Artificial  Intelligence  Research  In  Pilot 
Training- visual  Attention 

FY85  PROOUCTS 

Radar  Warning  Receiver  A  Fuel  Savings  Advisory 
Part-Task  Trainers 

Alr-to-AIr  Measurement  System  Specification 

Model  Aircrew  Training  System  Specification 

Air  Force  Electronic  Combat  Training  Roadmap 

Low-Altitude  Navigation  A  Targeting 
Infrared  Night  Simulation 

Advanced  Visual  Image  Generation 

Visual  Colllmatlon  Requirements 

Second  Generation  Fiber-Optic  Helmet-Mounted  Display 

LOGISTICS  AND  HUMAN  FACTORS  DIVISION 
FV80  PROOUCTS 

Models  of  Maintenance  Resource  Interactions 
FY81  PRODUCTS 

Handbook  for  Selection  of  Format  Options  for 
Procurement  of  Technical  Data 

Air  Force  Aircraft  Battle  Damage  Repair  Study 

Draft  Military  Specifications  for  Maintenance  Task 
Analysis  and  Logic  Tree  Troubleshooting  Aids 

Sensor  Simulation  for  Target  Acquisition  Training 

FY82  PRODUCTS 

Analysis  to  Improve  the  Maintenance  Environment 
Tactical  Air  Warfare  Center  Support 


ASD,  MAJCOMs 

AFOSR,  Defense  Advanced  Research  Products 
Agency  (DARPA 

USERS 

TAC,  SAC,  MAC 

ATC,  TAC 

ATC,  TAC,  MAC,  SAC 
SAC 

TAC,  SIMSPO 

ASD/EN,  MAJCOMs 
ASD,  AAMRL,  Army.  Navy 
ASD,  AAMRL,  Army,  Navy 

USERS 

Air  Force  Wright  Aeronautical  Laboratories  (AFWAL) 

USERS 

Air  Force  Logistics  Coamand  (AFLC),  Air  Force 
Institute  of  Technology  (AFIT) 

SP Os,  Technical  Order  Management  Agencies  (TOMAs) 

AFLC,  Air  Force  Logistics  and  Engineering  (HQ  AF/LE), 

US  Air  Forces  In  Europe  (USAFE),  ASD, 

Air  Force  Acquisition  Logistics  Division  (AFALD),  AFWAL 

ASD 

ASD 

USERS 

AFLC,  MAJCOMs,  AF/LE 
USAF/TAWC 


Three-Dimensional  Display  for  Training  Weapons 
Directors 

Acquisition  of  Supportable  $y steals  Evaluation 
Technology  (ASSET) 

Sneak  Circuit  Analysis  Applied  to  Development  of 
Fault  Isolation  Procedures 

FY83  PRODUCTS 

Unified  Database  Technology 

Logistics  Analyses  for  the  Integrated 
Communications  Navigation  Identification  Avionics 
(ICNIA)  Systeai 

Maintenance  Deaand  Metrics  for  Peacetime  Operations 

Analysis  to  improve  the  Maintenance  Envlromaent 
(Missiles  and  Reserve  Forces) 

FY84  PRODUCTS 

Pilot  Study  of  Wartime  Deaand  Rates  for  Aircraft 
Electronic  Counteraeasures  Equipment 

lapact  Analysis  Techniques 

Tactical  Battle  Manageaent  Software  Simulation 
(TBMS)  System 

Tactical  Coaaand  and  Control  Coabat  Planning 
and  Attack  Capability  (COMPAC) 

FY85  PRODUCTS 

Prediction  Models 

Automated  Databases 

Prototype  Demonstration 

Maintenance  A  Logistics  In  Computer-Aided  Design 
Demonstration 

Specification  A  Standards 

Unified  Database  for  Acquisition  Logistics 

Computer  Graphics  Model  of  Maintenance  Technician 


TAC,  ATC 

AFSC,  ASD,  AFLC,  Army,  Navy 

TAC,  AFALD,  Air  Force  Coordinating  Office  for 
Logistics  Research  (AFCOLR),  AFLC,  ASD,  Air  Forces 
Logistics  Management  Center  (AFLMC) 

USERS 

AFALD,  B-l  SPO 
AFWAL 

AFLC,  AFALD,  TAC 

AFLC,  AF/LE,  SAC,  Air  Force  Reserve  (AFRES) 

USERS 

AFLC,  AFWAL,  TAC 

AFLC,  AFALD,  AFWAL 

Electronic  Systems  Division  (ESD),  Rome  Air 
Development  Center  (RADC),  USAFE,  TAC 

ESD,  RADC,  USAFE,  TAC 

AFWAL 

AFLC 

MAJCOMs 

AFWAL 

AFLC,  AFIT,  SPOs,  ASD 
AFALD,  B-l  SPO 
AFWAL 


TWINING  SYSTEMS  DIVISION 


FYNO  PROOUCTS 

Mr Iters  A14I  Computer  Program 

Oevelopme nt  and  Validation  of  the 
Learning  Strategies  and  Skills 
Training  Progran 

Evaluation  of  the  High-Fidelity  6883 
Maintenance  Simulator 

Development  of  the  On-the-Job  Training 
(OJT)  Capacity  Model 

FV81  PROOUCTS 

A  Testing  and  Instructional  System  Based 
on  Nlcrotenrinal  and  Microfiche  Devices 

Computer  Dialog  for  Graphics  Simulation 
Programs 

Handbooks  and  Model  Specifications  for  the 
Design  and  Development  of  Maintenance 
Simulators 

Functional  Literacy  Task  Inventory 

FT82  PROOUCTS 

Computerized  Adaptive  Measurement  of 
Achievement 

Forward-Looking  Resource  Scheduling  (FLRS) 

Maintenance  Training  Analysis  and  Functional 
Specification  Development  for  a  Mlnuteman 
Maintenance  Training  Simulator 

Individualized  Student  Pre-Course  Skill 
Training  for  Computer-Managed  Instruction 

Computer-Assisted  Instruction  (CAI)  Course¬ 
ware  Development 

Development  of  the  Flat-Panel  6883  Simulator 

FY83  PROOUCTS 

Improved  USAF  Non-Destructive  Inspection 
Technician  Capabilities 


USERS 

AFSC 

ATC 

SIMSPO,  ATC 

HQ  USAF/MPP 

USERS 

ATC 

ASO,  ATC,  MAC,  SAC,  Space  Command 

ASD,  8-1  SPO,  F-15  SPO,  SIMSPO 

USAF/MPP 

USERS 

ATC,  Any,  Navy 

TAC 

ASD,  SAC 

ATC,  Any,  Navy 

AFMPC,  Department  of  Energy  (DOE),  SAC,  Navy 

ASO,  ATC 

USERS 

AFLC 


I 


Personnel  Requirements  for  Ron-Conventional 
Instruction 

Pevel  opmant  of  Instructional  Treatment 
A1  ternatl ves  Applicable  to  Technical 
Training 

Cooperative  Evaluation  of  High-  and  Low- 
Fidelity  6683  Maintenance  Simulators 
with  Actual  Equipment 

Acquiring  Setter  Maintenance  Trainers 

FY84  PRODUCTS 


Instructional  Support  Software  (ISS) 

Ada  Manpower  and  Training  Requirements 

Ada  Computer- Aided  Instruction  (CAI) 
Courseware  Development 

Integrated  Training  System  (ITS)  for  Air 
Force  OJT 

Development  Procedures  for  Task  Evaluation 
Forms 

CAI  Oeclslon  Handbook 

Field  Evaluation  of  a  Low-Cost  Microcomputer 
Flsche-Based  Simulation  System  for  Flight 
Simulator  Troubleshooting  Training 

Computer-Based  Training  (CBT)  Selection 
Assistance  for  Space  Coaund 

Intelligent  Systems  Technology 

Maintenance  Training  Simulator  Synthesis 
Study 

Graphics/Actual  Equipment  Maintenance 
Training  Study 

FY85  PROOUCTS 


Instructional  Support  Software  System 
Speech  Recognition 
Knowledge  Engineering 


ATC 

ATC 

ASD 

SI MSP 0,  ATC 
USERS 

ATC,  NAJCOMs 

Joint  Ada  Program  Office 
Joint  Ada  Program  Office 

AFSC,  TAC 

TAC 

ATC 

SAC 

Space  Command 

AFSC 

SIMSPO 

SIMSPO,  ATC 

USERS  , 

ATC,  MAJCOMs  j 

j 

ATC,  MAJCOMs  j 

ATC  j 

f 

{ 


Knowledge  Acqulsltlon/Intelllgent  Authoring  Aids 


AFSC 


Advanced  On-tbe-Job  Training  System  Prototype 


HQ  USAF/MPP 


Operational  Unit  Job  Proficiency  Assessaent 
Methodology 

Training  Programs  for  Individuals  A  Teaes 
Autoaated  Task  Data  Collection  Tools 
Huaan  Performance  Design  6uides 


AFSC,  TAC 

ATC 

ATC 

ATC,  Army,  Navy 


UNCLASSIFIED  TECHNICAL  REPORTS 

DISTRIBUTED  IN  FY86 

AFHRL  Plans  and  Programs  Office.  Fiscal 
year  1986  -  Air  Force  technical  ob- 
ective  document .  AFHRL-TR-85 -24 
AD-A160  639). 

AFHRL  Plans  and  Operations  Office. 
Fiscal  year  1987  -  Air  Force  techni¬ 
cal  objective  document.  AFHRL-TR- 
86-16  UD-A167  348). 

Bordelon,  V.  P.,  &  Kantor,  J.  E.  Uti¬ 
lization  of  psychomotor  screening 
for  USAF  pilot  candidates:  Indepen¬ 
dent  and  Integrated  selection  method¬ 
ologies.  AFHRL-TR-86-4  (AD-A170  353). 
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Basic  Attributes  Test  (BAT)  system; 
A  preliminary  evaluation.  Paper  pre¬ 
sented  at  the  30th  Annual  Meeting  of 
the  Human  Factors  Society,  Dayton, 
OH. 


Chrlstal,  R.  (1986,  April).  Applica¬ 
tion  of  cognitive  science  principles; 
A  view  from  the  experts.  Paper  pre¬ 
sented  at  the  American  Educational 
Research  Association  Conference,  San 
Francisco,  CA. 


Clay,  J.D.  (1986,  April).  Development 
of  computer-based  maintenance  aids 
system.  Paper  presented  at  the  10th 
Annual  Psychology  in  the  DOD  Sympo¬ 
sium,  Colorado  Springs,  CO. 


Coleman,  J.  W.  (1986,  April).  A  com¬ 
parison  of  estimation  techniques  for 
the  pareto  distribution.  Paper  pre¬ 
sented  at  the  joint  national  meeting 
of  the  Institute  of  Management  Sci¬ 
ence  and  the  Operation  Research  Soci¬ 
ety  of  America,  Los  Angeles,  CA. 


Lt  Col  Joseph 
Coleman 


Collins,  D.L.  (1986,  April).  Training 
issues  relevant  to  non-traditional 
human-computer  interfaces.  Paper 
presented  at  the  10th  Annual  Psychol¬ 
ogy  in  the  DOD  Symposium,  Colorado 
Springs,  CO. 


Maj  Daniel 
Collins 


Collins,  D.L.  (1986,  August).  Educa¬ 
tional  opportunities  associated  with 
computer-assisted  instruction  and 
computer-generated  speech.  Paper 
presented  at  the  American  Psychologi¬ 
cal  Association  Convention,  Washing¬ 
ton,  DC. 


Cummins,  J.,  Lamm,  J.,  &  Weaver,  C.N. 
(1986,  March).  Conf idence  in  bank¬ 
ers:  Evidence  from  five  nationwide 

surveys.  Paper  presented  at  the 
Southwestern  Society  of  Economists, 
Dallas,  TX. 

Dallman,  B.  (1986,  March).  Intelligent 
tutorial  systems  research.  Paper 
presented  at  the  1986  Air  Force  Tech¬ 
nology  in  Training  and  Education  Con¬ 
ference,  Montgomery,  AL. 

Drake,  G.  (1986,  May).  Pilot  selection 
and  classification  research.  Paper 
presented  at  the  Meeting  of  the 
Department  of  Defense  Sub-Technical 
Advisory  Group  on  Aviation  Selection 
and  Performance,  Cocoa  Beach,  FL. 

Edwards,  B.J.,  &  Miller,  J.  (1986, 

March) .  Effectiveness  of  low-cost 
simulation  for  aircrew  procedures 
training.  Paper  presented  at  the 
1986  Air  Force  Technology  in  Train¬ 
ing  and  Education  Conference,  Mont¬ 
gomery,  AL. 


Geri,  G.  A.,  &  Neri,  D.  F.  (1986, 

October) .  An  evaluation  of  the  Klntz 
solid-state  anomaloscope.  Paper  pre¬ 
sented  at  the  Optical  Society  of 
America,  Seattle,  WA. 


Given,  K.  C.  (1986,  April).  Aircrew 
selection  and  screening.  Paper  pre¬ 
sented  at  the  Australian  Air  Attache 
Seminar,  Washington,  DC. 


Gott,  S.  P.  (1986,  April).  Tutoring 
troubleshooting  in  an  electronics 


micro -world.  Paper  presented  at  the 
American  Educational  Research  Associ¬ 
ation  Conference,  San  Francisco,  CA. 


Dr.  Sherri 
Gott 


Gott,  S.P.  (1986,  April).  Utility  of 
cognitive  task  analysis  for  examining 
complex  technical  skills.  Paper  pre¬ 
sented  at  the  American  Educational 
Research  Association  Conference,  San 
Francisco,  CA. 

Gray,  T.  H  .  (1986,  October).  Perspec¬ 
tives  on  training  research  and  devel 
opinent  at  the  Operations  Tralnin 


Division.  Paper  presented  at  the 
U.S.  Army  Simulator  Definition  Con¬ 
ference,  Fort  Rucker,  AL. 


Dr.  Jerry 
Hedge 


Hedge,  J.W.,  Ballentlne,  R.D.,  &  Gould, 
R.  B.  (1985,  October).  Examining  the 
link  between  training  evaluation  and 
job  performance  criterion  develop¬ 
ment.  Paper  presented  at  the  NATO 
Defense  Research  Group  Panel  VIII, 
Brussels,  Belgium. 

•  '  * 


Dr.  Bruce 


Gould 


Dr.  Thomas 
Gray 


Hartke,  D.  D.,  &  Short,  L.  0.  (1986, 

August).  Meta-analysls  of  Air  Force 
Officer  Qualifying  Test  validities. 
Paper  presented  at  the  American  Psy¬ 
chological  Association  Convention, 
Washington,  DC. 

Hedge,  J.W.  (1986,  August).  Issues  In 
b  performance  measurement  research. 


Paper  presented  at  the  American  Psy 
etiological  Association  Convention, 
Washington,  DC. 


Hedge,  J.W. ,  &  Lipscomb,  M.S.  (1986, 
August).  The  Identification  of 
surrogate  Indices  of  hands-on  per¬ 
formance.  Paper  presented  at  the 
American  Psychological  Association 
Convention,  Washington,  DC. 

Hedge,  J.W.,  &  Teachout,  M.S.  (1986, 
April).  Job  performance  measurement: 
A  systematic  program  of  research  and 
development.  Paper  presented  at  the 
Annual  Conference  of  the  Society  for 
Indust rial /Organizational  Psychology, 
Chicago,  IL. 

Hubbard,  D.C.  (1986,  August).  Graphl- 
cal  data  analysis  of  two  selected 


data  sets .  Paper  presented  at  the 
1986  Joint  Statistical  Meeting,  Chi¬ 
cago,  IL. 


Hubbard,  D.C.,  &  Polzella,  D.J.  (1986, 
March) .  Utility  and  utilization  of 

advanced  Instructional  features  in 
Air  Force  electronic  warfare  train¬ 
ers.  Paper  presented  at  the  1986  Air 
Force  Technology  In  Training  and  Edu¬ 
cation  Conference,  Montgomery,  AL. 


Mr.  Robert 
Johnson 


Johnson,  R.  C.  (1985,  October).  Inte¬ 
grated  maintenance  information  sys¬ 
tem.  Paper  presented  at  the  NSIA  In¬ 
tegrated  Diagnostics  Meeting,  Long 
Beach,  CA. 


Johnson,  R.C.  (1986,  June).  Computer- 
based  maintenance  aids  system/ 
Integrated  maintenance  Information 
system.  Paper  presented  at  the  In¬ 
terservice  Group  on  Exchange  of  Tech¬ 
nical  Manual  Technology,  Roseville, 
Ml. 


Mr.  Jerry 
Kaachl 


Kaachl,  J.S.,  Furman,  J.,  &  David,  M. 
(1986,  July).  Simulation  capabili¬ 
ties:  The  facility  and  TEMPEST  part 
of  the  equation.  Paper  presented  at 
the  1986  Summer  Computer  Simulation 
Conference,  Reno,  NV. 


Mr.  Jonathan 
Furman 


Kantor,  J.E.  (1986,  August).  Air  Force 
aircrew  selection  and  classification 
research.  Paper  presented  at  the 
American  Psychological  Association 
Convention,  Washington,  DC. 


Kellogg,  R.  S.,  &  Gillingham,  K.  K. 

(1986,  September).  USAF  experience 
with  simulator  sickness,  research 
and  training.  Paper  presented  at 
the  30th  Annual  Meeting  of  the  Human 
Factors  Society,  Dayton,  OH. 


Kerchner,  R. ,  &  Weaver,  C.  (1986,  May). 
Participation  on  performance  stand¬ 
ards  and  measures  panel,  6th  Annual 
NSIA/DOD/  Industry  Conference  on 
Personnel  and  Training  Factors  In 
Systems  Effectiveness,  San  Diego,  CA. 


Knerr,  C.  M. ,  &  DeYoe,  P.  (1986,  May). 
Decision  support  system  for  part-task 
training.  Paper  presented  at  the 
Institute  of  Electrical  and  Elec¬ 
tronics  Engineers  Conference,  Dayton, 
OH. 


Kyllonen,  P.  C.,  &  Tlrre,  W.  C.  (1986, 
April).  Memory  organization  as  a 
determinant  of  learning.  Paper  pre- 
sented  in  R.E.  Snow  (Chair),  Determi¬ 
nants  of  individual  differences  in 
learning.  Symposium  conducted  as 
part  of  the  Annual  Meeting  of  the 
American  Educational  Research  Asso¬ 
ciation,  San  Francisco,  CA. 


Lohman,  D.F.  (1986,  April).  Improving 
spatial  abilities:  What  transfers 
after  practice  on  mental  rotation? 
Paper  presented  at  the  Annual  Meeting 


VS<‘ 


'V.v 


v.V 


of  Che  American  Educational  Research 
Association,  San  Francisco,  CA. 

Loo per,  L.  T.  (1986,  April).  Decision 
analysis  sesinar  on  ongoing  research. 
Panel  discussion  at  the  Joint  Nation¬ 
al  Meeting  of  the  Institute  of  Man- 
ageaent  Science/Operations  Research 
Society  of  Aaerlca,  Los  Angeles,  CA. 


Looper,  L.  T. ,  &  Stone,  B.  M.  (1986, 
April).  Air  Force  reenlistment  anal¬ 
ysis  model.  Paper  presented  at  the 
Joint  National  Meeting  of  the  Insti¬ 
tute  of  Management  Science/Operations 
Research  Society  of  America,  Los 
Angeles,  CA. 

Massey,  R.H.  (1986,  March).  A  taxonomy 
of  maintenance  simulator  trainers. 
Paper  presented  at  the  1986  Air  Force 
Technology  in  Training  and  Education 
Conference,  Montgomery,  AL. 

Mitchell,  J.L.,  &  Driskill,  W.E.  (1986, 
August ) .  Optimising  Integrated  per¬ 
sonnel  system  training  decisions  and 
development .  Paper  presented  at  the 
American  Psychological  Association 
Convention,  Washington,  DC. 

Mlttleholtz,  D.  J.,  &  Lohman,  D.  F. 

(1986,  April).  Effects  of  extensive 
practice  without  feedback  on  perform¬ 
ance  on  a  spatial  synthesis  task. 
Paper  presented  at  the  Annual  Meeting 


Moran,  G.  V.,  &  Ballentlne,  R.D.  (1986, 
Angus t ) .  Effects  of  job  experience 
on  performance  scores .  Paper  pre¬ 
sented  at  the  American  Psychological 
Association  Convention,  Washington, 
DC. 

Mumford,  M.  D. ,  Harding,  F.  D. ,  Weeks, 
J.L.,  &  Fleishman,  E.A.  (1986, 

August ) .  Assessing  the  difficulty  of 
military  occupations.  Paper  present¬ 
ed  at  the  American  Psychological 
Association  Convention,  Washington, 
DC. 

Nichols,  P.  D. ,  &  Lohman,  D.  J.  (1986, 
April).  Intelligence,  spatial  abili¬ 
ty,  and  the  automatlclty  of  informa¬ 
tion  processing.  Paper  presented  at 
the  Annual  Meeting  of  the  American 
Educational  Research  Association, 
San  Francisco,  CA. 

Obermayer,  R. ,  Waag,  W.  L.,  &  Comstock, 
W.J.  (1986,  March).  Performance  meas¬ 
urement  systems  for  flight  combat 
mission  Instruction  and  instructional 
research.  Paper  presented  at  the  1986 
Eastern  Simulation  Conference, 
Norfolk,  VA. 

Olson,  W.R.,  JCryway,  J.T.,  &  Easter, 
A.W.  (1985,  November).  Instructional 
features  and  the  user.  Paper  pre¬ 
sented  at  the  7th  Interservice/ 


of  the  American  Educational  Research  Industry  Training  Equipment  Confer- 

Assoclatlon,  San  Francisco,  CA.  ence,  Orlando,  FL. 


Meeting  of  the  Psychonomic  Society, 
Boston,  MA. 


Pellegrino,  J.W.  (1986,  April).  Indi¬ 
vidual  differences  in  skill  acquisi¬ 
tion:  Information  processing  effi- 

ciency  and  the  development  of  automa- 
tlclty.  Paper  presented  in  R.E.  Snow 
(Chair),  Deteralnants  of  individual 
differences  in  learning.  Symposium 
conducted  as  part  of  the  Annual  Meet¬ 
ing  of  the  Aaerlcan  Educational  Re¬ 
search  Association,  San  Francisco, 
CA. 


Dr.  Manuel 
Pina,  Jr. 


Pina,  M.,  Jr.  (1986,  April).  The  Air 
Force's  job  assignment  procedures. 
Paper  presented  at  the  Joint  Nation¬ 
al  Meeting  of  the  Institute  of  Man¬ 
agement  Science/Operations  Research 
Society  of  America,  Los  Angeles,  CA. 
Utility  and  utilization  of  aircrew 
training  device  advanced  instruction¬ 
al  features.  Paper  presented  at  the 
30th  Annual  Meeting  of  the  Human 
Factors  Society,  Dayton,  OH. 


Pritchard,  R.D.  (1985,  October).  Pro¬ 
ductivity.  Society  for  Organiza¬ 
tional  Behavior,  and  the  Houston 
Association  of  Industrial /Organiza¬ 
tional  Psychologists,  Houston,  IX. 

Ree,  M.  J.  (1985,  December).  Validity 
for  1990a  and  beyond.  Keynote  ad¬ 
dress.  Educational  Testing  Service 
Conference,  Princeton,  NJ. 

Reglan,  J.W.,  Shute  V.J.,  &  Pellegrino, 
J.W.  (1985,  November).  The  modifia¬ 
bility  of  spatial  processing  skills. 
Paper  presented  at  the  26th  Annual 


Richardson,  J.  J.  (1986,  February). 
Artificial  intelligence  technology 
for  the  maintained s  associate. 
Paper  presented  at  the  National 
Security  Industrial  Association's 
Conference  on  Implementation  of 
Integrated  Diagnostics,  Alexandria, 
VA. 


Siem,  F.M.,  &  Carretta,  T.R.  (1986, 
May).  The  development  and  initial 
validation  of  the  Basic  Attributes 
Test  system.  Paper  presented  at  the 
2nd  Annual  South  Texas  Symposium  on 
Human  Factors  and  Ergonomics,  Univer¬ 
sity  of  Texas  at  San  Antonio. 

Stephenson,  R.W.  (1986,  May).  Relative 
costa  and  benefits  of  aircrew  train¬ 
ing  equipment  systems.  Paper  pre¬ 
sented  at  the  1986  National  Aerospace 
and  Electronics  Conference,  Dayton, 
OH. 


Steuck,  X.W,  &  Perea,  P.  (1986,  April). 
An  assessment  of  multi-option  ques¬ 
tions  in  metamemory  research.  Paper 
presented  at  the  Annual  Meeting  of 
the  American  Educational  Research 
Association,  San  Francisco,  CA. 


Mr.  Mark 
Teachout 


Teachout,  M.  S.  (1986,  August).  Devel¬ 
oping  a  composite  measure  of  job 
performance:  Problems  and  solutions. 
Paper  presented  at  the  American  Psy¬ 
chological  Association  Convention, 
Washington,  DC. 


Teachout,  M.S.,  Dickinson,  T.L.,  Woods, 
S.B.,  &  Mathleu,  J.E.  (1986,  April). 
A  time-based  assessment  of  the  con¬ 
struct  vslldlty  of  performance  rat¬ 
ings.  Paper  presented  at  the  7th 
Annual  Industrial /Organizational  and 
Organizational  Behavior  Graduate 
Student  Convention,  Minneapolis,  MN. 


Tirre,  W.C.  (1986,  February).  Informa¬ 
tion  processing  correlates  of  in¬ 
telligence:  New  information  from 

computer-administered  tests.  Paper 
presented  at  the  Annual  Meeting  of 
the  Southwestern  Educational  Research 
Association,  Houston,  TX. 


Tirre,  W.  C.,  &  Rancourt,  C.  R.  (1986, 
April).  Individual  differences  in 
learning  by  accretion:  It  all  begins 
with  comprehension.  Paper  presented 
in  RE.  Snow  (Chair),  Determinants  of 
individual  differences  in  learning. 
Symposium  conducted  as  part  of  the 
Annual  Meeting  of  the  American  Educa¬ 
tional  Research  Association,  San 
Francisco,  CA. 


Towle,  K.  E.,  &  Thomas,  M.  (1985, 

November) .  Spectral  matching  of 
light  valve  projectors  used  for  simu¬ 
lation.  Paper  presented  at  the  7th 
Interservice/Industry  Training  Equip¬ 
ment  Conference,  Orlando,  FL. 


Venturlno,  M.  (1986,  September).  Peri¬ 
pheral  vision  and  peripheral  dis¬ 
plays.  Symposium  chaired  at  the  30th 
Annual  Human  Factors  Society  Meeting, 
Dayton,  OH. 


Venturlno,  M.  (1986,  September).  Time¬ 
sharing,  cognition,  and  human 
performance  in  complex  information 
systems.  Symposium  chaired  at  the 
30th  Annual  Human  Factors  Society 
Mee'tlng,  Dayton,  OH. 


Watson,  T.  W.  (1986,  August).  Full- 
scale  test  of  an  empirical  model  of 
turnover.  Paper  presented  at  the 
Annual  Meeting  of  the  Academy  of  Man¬ 
agement,  Chicago,  IL. 


Watson,  T.  W.,  &  Appel,  V.  H.  (1986, 

April).  Implications  of  the  results 
of  recent  turnover  research  for  Air 
Force  policy.  Paper  presented  at  the 
10th  Psychology  in  the  DOD  Symposium, 
Colorado  Springs,  CO. 


Dr.  Thomas 
Watson 


1 


Weaver,  C.  N.  (1985,  December).  In¬ 
creasing  productivity  in  Air  Force 
jobs  through  feedback,  goal  setting, 
and  incentive  systems.  Paper  pre¬ 
sented  at  the  1985  Department  of 
Defense  Productivity  Conference, 
Leesburg,  VA. 


Weaver,  C.N.  (1986,  May).  Productivity 
R&D  at  the  Air  Force  Human  Resources 
Laboratory.  Paper  presented  at  the 
National  Security  Industrial  Associa¬ 
tion’s  Conference  on  Implementation 
of  Integrated  Diagnostics,  Alexan¬ 
dria,  VA. 


Weaver,  C.N.  (1986,  June).  Enhanc ing 
productivity  through  feedback,  goal 
setting,  and  incentive  systems. 
Paper  presented  at  the  1986  Elec- 
tronic  Security  Command,  San  Antonio, 
TX. 


Weaver,  C.N.,  Alais,  R.M.,  &  Franz, 

R.S.  (1986,  March).  Public  attitudes 
and  trade  relations.  Paper  presented 
at  the  Southwestern  Economics  Asso¬ 
ciation,  San  Antonio,  TX. 


Weaver,  C.N.,  Alais,  R.M.,  Franz,  R.S., 
&  Carpenter,  J.B.  (1986,  April).  U.S . 
public  attitudes  and  trade  relations 
with  eight  countries:  Further  tests 
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for  relationship.  Paper  presented 
at  the  International  Atlantic  Eco¬ 
nomic  Association,  St.  Thomas,  U.S. 
Virgin  Islands. 

Weaver,  C.N.,  &  Carpenter,  J.B.  (1986, 
April).  Is  labor  to  blame  for  the 
decline  in  U.S.  productivity?  Paper 
presented  at  the  International 
Atlantic  Economic  Association,  St. 
Thomas,  U.S.  Virgin  Islands. 


Dr.  Charles 
Weaver 


Weaver,  C.  N.,  &  Schultz,  M.  (1986, 
March).  Professionals  and  job  auton¬ 
omy:  Do  they  really  want  more? 

Paper  presented  at  the  Southwestern 
Society  of  Economists,  Dallas,  TX. 

Wegner,  T.G.  (1986,  April).  Appropri¬ 
ateness  of  the  Armed  Services  Voca¬ 
tional  Aptitude  Battery  for  ninth  and 


tenth  graders.  Paper  presented  at 
the  10th  Annual  Psychology  in  the 
DOD  Symposium,  Colorado  Springs,  CO. 


Welch,  B.  L.,  &  Kruk,  R.  (1986,  May). 
Engineering  and  human  visual  con¬ 
siderations  in  development  of  a 


fiber-optic  helmet-mounted  display. 
Paper  presented  at  the  Royal  Aero¬ 
nautical  Society,  London,  England. 


Welsh,  J.  (1986,  April).  The  develop¬ 
ment  and  calibration  of  an  adaptive 
ASVAB  item  pool .  Paper  presented  at 
the  1st  Annual  Convention  of  the 
Society  for  Industrial  and  Organiza¬ 
tional  Psychology,  Chicago,  IL. 


Woltz,  D.J.  (1986,  April).  The  role 
of  working  memory  in  associative 
learning.  Paper  presented  in  R.E. 
Snow  (Chair),  Determinants  of  indivi¬ 
dual  differences  in  learning.  Sympo¬ 
sium  conducted  as  part  of  the  Annual 
Meeting  of  the  American  Educational 
Research  Association,  San  Francisco, 
CA. 


Yasutake,  J.Y.  (1986,  May).  Participa¬ 
tion  on  skills  sustainment  panel,  6th 
Annual  NS IA/DOD/ Indus try  Conference 
on  Personnel  and  Training  Factors  in 
Systems  Effectiveness,  San  Diego,  CA. 
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CONFERENCES /WORKSHOPS  HOSTED  BY  AFHRL  IN  FY86 


30  October-1  November 
23-25  June  1986 

November  1985 

9-11  January  1986 
27-31  January  1986 

18-19  March  1986 

April  1986 
April  1986 

1- 2  May  1986 

2- 6  June  1986 

21-23  July  1986 

August  1986 

3- 4  September  1986 


1985  Semiannual  Progress  Reviews,  Basic  Job  skills 
Research  Program: 

At  both  reviews,  Air  Force  and  university/ 
industrial  researchers,  plus  interested  rep¬ 
resentatives  from  the  Air  Staff  and  MAJCOMs 
attended.  Audiences  were  between  60  and  75 
people. 


Joint  Services  Selection  and  Classification 
Working  Group 


Defense  Advisory  Committee  on  Military  Per- 
sonel  Testing 

SIMSCRIPT  II. 5  Course  taught  by  CACI, 

Inc. -Federal,  Brooks  AFB,  TX 


Reliability  and  Maintainability  in  Computer- 
Aided  Design  (RAMCAD)  Technical  Interchange 
Meetings  at  the  Institute  for  Defense  Analy¬ 
sis,  Washington  DC 


Conference  on  Validity  for  the  1990s  and 

R&D  Coordination  Conference,  Phoenix,  AZ 
Beyond 

Division  Advisory  Group  Visit,  Phoenix,  AZ 

EURO-NATO  Aircrew  Selection  Working  Group 
Brooks  AFB,  TX 


Working  Group  on  Operator  Capacity  Limits 
in  Complex  Information  Processing  Systems, 
Dayton,  OH 


DOD  Future  Test  Technology  Committee 


Air  Force  Human  Resources  Laboratory  Research 
Planning  Forum  for  Intelligent  Tutoring 
Systems,  San  Antonio,  TX 


12  February  1967 
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Colonel  Dennis  W.  Jarvl 

Commander 

AFHRL/CC 

Brooks  AFB,  TX  78235-5601 
(512)  536-2665 
AUTOVON  240-2665 


Colonel  Harold  G.  Jensen 
Vice  Commander 
AFHRL/CV 

Brooks  AFB,  TX  78235-5601 
(512)  536-3605 
AUTOVON  240-3605 


Dr.  Hebert  J.  Clark 

Director,  Plans  &  Operations  Office 

AFHRL/XO 

Brooks  AFB,  TX  78235-5601 
(512)  536-3611 
AUTOVON  240-3611 


Captain  James  E.  Watson 

Director,  Executive  Support  Office 

AFHRL/SU 

Brooks  AFB,  TX  78235-5601 
(512)  536-3386 
AUTOVON  240-3386 


Colonel  Ronald  L.  Rerchner 

Chief,  Manpower  &  Personnel  Division 

AFHRL/MO 

Brooks  AFB,  TX  78235-5601 
(512)  536-2244 
AUTOVON  240-2244 


Colonel  Donald  C.  Tetmeyer 

Chief,  Logistics  &  Human  Factors  Division 

AFHRL/LR 

Wright-Patterson  AFB,  OH  45433-5000 
(513)  255-6797 
AUTOVON  785-6797 


Colonel  Gene  A.  Berry 

Chief,  Training  Systems  Division 

AFHRL/ID 

Brooks  AFB,  TX  78235-5601 
(512)  536-2913 
AUTOVON  240-2913 


Dr.  Robert  A.  Bottenberg 

Chief,  Technical  Services  Division 

AFHRL/TS 

Brooks  AFB,  TX  78235-5601 
(512)  536-3841 
AUTOVON  240-3841 


Colonel  Michael  C.  Lane 

Chief,  Operations  Training  Division 

AFHRL/OT 

Williams  AFB,  AZ  85240-6457 
(602)  988-6561 
AUTOVON  474-6561 


